Welcome to Tesla Motors Club
Discuss Tesla's Model S, Model 3, Model X, Model Y, Cybertruck, Roadster and More.
Register

IIHS compares driver assistance Tesla, MB, BMW Volvo

bhzmark

Active Member
Jul 21, 2013
3,426
5,167
Tests uncover issues for advanced features

Some interesting highlights are below the Model S tested is a 2016 with 7.1 software and probably AP1 hardware. It did well except for hill crests. The Model 3 with AP2 did even better.

upload_2018-8-7_6-24-41.png



The 2017 BMW 5-series with "Driving Assistant Plus," 2017 Mercedes-Benz E-Class with "Drive Pilot," 2018 Tesla Model 3 and 2016 Model S with "Autopilot" (software versions 8.1 and 7.1, respectively) and 2018 Volvo S90 with "Pilot Assist" were evaluated. All five have automatic emergency braking systems rated superior by IIHS.

One series involved driving at 31 mph toward a stationary vehicle target with ACC off and autobrake turned on to evaluate autobrake performance. Only the two Teslas hit the stationary target in this test.

The same test was repeated with ACC engaged and set to close, middle and far following distance in multiple runs.

With ACC active, the 5-series, E-Class, Model 3 and Model S braked earlier and gentler than with emergency braking and still avoided the target. The cars slowed with relatively gradual decelerations of 0.2-0.3 gs, braking in the same manner no matter the distance setting. Braking before impact was earlier for the Teslas than for the 5 series and E-Class.

. . . .

A fourth scenario involved the test vehicle following a lead vehicle, which then changed lanes to reveal a stationary inflatable target vehicle in the path ahead when the time to collision was about 4.3 seconds.

None of the vehicles crashed into the target, and the 5 series, E-Class and Teslas all braked earlier and gentler than the S90, similar to the active ACC test.

. . .Out on the road, engineers noted instances in which each vehicle except the Model 3 failed to respond to stopped vehicles ahead.

. . .

Unnecessary or overly cautious braking is an issue IIHS noted in the Model 3. In 180 miles, the car unexpectedly slowed down 12 times, seven of which coincided with tree shadows on the road. The others were for oncoming vehicles in another lane or vehicles crossing the road far ahead.

. . .

Only the Model 3 stayed within the lane on all 18 trials. The Model S [with the older hardware and software] was similar but overcorrected on one curve, causing it to cross the line on the inside of the curve in one trial. None of the other systems tested provided enough steering input on their own to consistently stay in their lane, often requiring the driver to provide additional steering to successfully navigate the curve.

The E-Class stayed within the lane in 9 of 17 runs and strayed to the lane marker in five trials. The system disengaged itself in one trial and crossed the line in two. The 5 series stayed within the lane in 3 of 16 trials and was more likely to disengage than steer outside the lane. The S90 stayed in the lane in 9 of 17 runs and crossed the lane line in eight runs.

. . .

The E-Class stayed in its lane in 15 of 18 trials and on the line in one trial, continuously providing steering support without erratic moves when lane lines weren't visible. The Model 3 also stayed in the lane in all but one trial, when it hugged the line.

In contrast, the 5-series, Model S and S90 struggled. The 5-series steered toward or across the lane line regularly, requiring drivers to override the steering support to get it back on track. Sometimes the car disengaged steering assistance on its own. The car failed to stay in the lane on all 14 valid trials.

The Model S was errant in the hill tests, staying in the lane in 5 of 18 trials. When cresting hills, the Model S swerved left and right until it determined the correct place in the lane, jolting test drivers. It rarely warned them to take over as it hunted for the lane center. The car regularly veered into the adjacent lanes or onto the shoulder.
 

bhzmark

Active Member
Jul 21, 2013
3,426
5,167
And another article released today:

Advanced features reduce Model S claims

Some highlights:

The combined crash avoidance features on the Tesla Model S are reducing third-party physical damage and injury liability claims, while the benefit of adding "Autopilot" is limited to lowering collision claims.

. . .
The combined driver assistance features on the 2014–16 Model S lowered the frequency of claims filed under property damage liability (PDL) coverage by 11 percent and the frequency of claims under bodily injury (BI) liability coverage by 21 percent, compared with the 2012–14 Model S without the technology, HLDI found.

. . .

In this limited analysis, HLDI found that the frequency of claims filed under PDL, BI, MedPay and PIP didn't change once Autopilot was enabled, but the frequency of collision claims fell by 13 percent.

"To get a better picture of how Autopilot is affecting claims, we need more data on how many Teslas are equipped with Autopilot and how often it is used," says Matt Moore, HLDI's senior vice president. "The reductions in the frequency of third-party physical damage and injury liability claims associated with Tesla's version 1 hardware are in line with the benefits HLDI has documented for comparable systems from other manufacturers."

Moore adds, "When we evaluated Teslas with the version 1 hardware after the Autopilot software was deployed, we saw a significant reduction in collision claim frequency but no other changes."
 

Saghost

Well-Known Member
Oct 9, 2013
8,217
7,007
Delaware
"We're not ready to say which company has the best level 2 driver assistance" while the Model 3 turns in a basically perfect score and nothing else comes close. Charming.

(Driver assistance, not safety features. Another takeaway from this test is that Tesla needs to work on emergency braking with ACC off, which shouldn't really surprise folks that have been reading here. The test also shows how far Tesla has come in the last couple years.)
 
  • Like
Reactions: bhzmark and croman

Spidy

Active Member
Feb 7, 2015
1,364
1,035
EU
"We're not ready to say which company has the best level 2 driver assistance" while the Model 3 turns in a basically perfect score and nothing else comes close. Charming.
Except...

Unnecessary or overly cautious braking is an issue IIHS noted in the Model 3. In 180 miles, the car unexpectedly slowed down 12 times, seven of which coincided with tree shadows on the road. The others were for oncoming vehicles in another lane or vehicles crossing the road far ahead.
 
  • Helpful
Reactions: strangecosmos

Saghost

Well-Known Member
Oct 9, 2013
8,217
7,007
Delaware
Except...

Unnecessary or overly cautious braking is an issue IIHS noted in the Model 3. In 180 miles, the car unexpectedly slowed down 12 times, seven of which coincided with tree shadows on the road. The others were for oncoming vehicles in another lane or vehicles crossing the road far ahead.

A valid point. I was more focused on the chart at the end, which didn't include that part. Phantom braking has certainly annoyed a lot of people here.
 

jaguar36

Active Member
Apr 10, 2014
2,040
1,500
NJ
Unnecessary or overly cautious braking is an issue IIHS noted in the Model 3. In 180 miles, the car unexpectedly slowed down 12 times, seven of which coincided with tree shadows on the road. The others were for oncoming vehicles in another lane or vehicles crossing the road far ahead.
Its also been improved upon substantially in recent releases, however since IIHS doesn't seem to understand how OTAs work, they don't even acknowledge this as a possibility.
 

croman

Active Member
Nov 21, 2016
4,649
6,592
Chicago, IL
Its not that the IIHS doesn't understand OTA or software revisions, its that they want meaningful significant data and if the Teslas keep changing, they cannot build that data. Clearly Tesla's approach is superior and having one car with 7.1 and another with 8.1 shows that iterative improvement.
 

Saghost

Well-Known Member
Oct 9, 2013
8,217
7,007
Delaware
Its not that the IIHS doesn't understand OTA or software revisions, its that they want meaningful significant data and if the Teslas keep changing, they cannot build that data. Clearly Tesla's approach is superior and having one car with 7.1 and another with 8.1 shows that iterative improvement.

But as Mr Jaguar notes, they didn't provide a build version. We've been on 8.1 for more than a year, and seen big changes to AP performance during that time all with the 8.1 version number.

(Admittedly, this is Tesla making things confusing, but the only way I see that IIHS can unconfuse it is to show us the build our date of their version.)
 
  • Like
Reactions: bhzmark and daktari

strangecosmos

Non-Member
May 10, 2017
1,039
1,382
The Prime Material Plane
And another article released today:

Advanced features reduce Model S claims

This is potentially concerning:

“Looking at first-party injury coverage types, HLDI found a 29 percent increase in the frequency of claims under medical payment (Medpay) coverage and a 39 percent increase in the frequency of personal injury protection (PIP) claims.

MedPay covers injuries to an at-fault driver or passengers in that driver's vehicle, while PIP coverage is sold in states with no-fault insurance systems. This coverage pays for injuries to occupants of the insured vehicle, no matter who is at fault.”

But it’s hard to know what to do with the IIHS data — either the good or the bad. If you look at their report, a lot of the error bars are much larger than the effect sizes. What the heck are supposed to do with this?

wdyDenY.jpg
 
  • Informative
Reactions: Esme Es Mejor

Bladerskb

Senior Software Engineer
Oct 24, 2016
2,186
2,475
Michigan
"We're not ready to say which company has the best level 2 driver assistance" while the Model 3 turns in a basically perfect score and nothing else comes close. Charming.

(Driver assistance, not safety features. Another takeaway from this test is that Tesla needs to work on emergency braking with ACC off, which shouldn't really surprise folks that have been reading here. The test also shows how far Tesla has come in the last couple years.)

One thing to note is that GM Supercruise was not included in this test. which has been independently shown to be the best level 2 driver assistance.
 

EinSV

Active Member
Feb 6, 2016
4,328
21,513
NorCal
fw 8.0 was initially released in September 2016 (before AP2) so the 2016 Model S with 7.1 is almost certainly AP1.
Tesla

Bizarre that the IIHS would test using two year old firmware even on an AP1 car.

IMO, it was very misleading of the IIHS not to mention in their article that the Model S they tested was an AP1 car with long outdated, two-year old firmware. The ordinary reader would not have a clue what firmware 7.1 is.
 
Last edited:
  • Like
Reactions: croman and bhzmark

SlicedBr3ad

Member
Feb 25, 2017
922
828
Fl
fw 8.0 was initially released in September 2016 (before AP2) so the 2016 Model S with 7.1 is almost certainly AP1.
Tesla

Bizarre that the IIHS would test using two year old firmware even on an AP1 car.

IMO, it was very misleading of the IIHS not to mention in their article that the Model S they tested was an AP1 car with long outdated, two-year old firmware. The ordinary reader would not have a clue what firmware 7.1 is.

It's amazing that they still had a car with such old version. It's possible that even they were clueless. [Sigh]
 

EinSV

Active Member
Feb 6, 2016
4,328
21,513
NorCal
Here's a summary of the lane-keeping results from the last column of the chart above (dropping the Model S with outdated firmware):

Successfully navigated and stayed within lane:

Car Curves Hills
Model 3 100% 94.4%*
Mercedes E 50% 83.3%
Volvo S90 50% 50%
BMW 16% 0%

*Model 3 touched but did not cross dividing line on one occasion.
 

Bladerskb

Senior Software Engineer
Oct 24, 2016
2,186
2,475
Michigan
It wouldn't have worked on their test roads. LOL, such a great system!

objectively better than Tesla AP though..
We tested out Tesla Autopilot and Cadillac's Super Cruise — here's which one we liked better
The Battle for Best Semi-Autonomous System: Tesla Autopilot Vs. GM SuperCruise, Head-to-Head
Cadillac's semi-autonomous system is better than Tesla's or Volvo's
Cadillac Super Cruise Review: I like this more than Tesla Autopilot
How good is Cadillac’s Super Cruise ‘hands-free’ car technology?

and get this. GM released an update for super-cruise in June that improved three things:

“GM seems to have heard some of the criticisms we had of Super Cruise, because this update fixes several of those,” he says.

The updates include:

  • It’s easier for drivers to turn on Super Cruise. We found that the symbol that notifies drivers when using Super Cruise is allowed shows up more often, especially after lane changes. Previously, it could be difficult and frustrating for our drivers to determine why the symbol wasn’t appearing when all other factors seem to suggest it should be allowed.

  • The adaptive cruise control system has been tweaked to provide smoother acceleration and braking.

  • GM added 15 new messages to give drivers more information about why Super Cruise is not available or why it shut off. Those include messages alerting drivers that ACC needs to be on to start Super Cruise; that it can’t be used if forward-collision warning isn’t turned on; that the road they’re on isn’t appropriate for the system; or that it simply can’t find lane lines to follow.
GM Makes Super Cruise Driver-Assist System Easier to Use

So all the complaints have been addressed, easier and quicker to activate. ACC/cut-in greatly improved. And more UI/UX upgrades.

The reason i'm so pro supercruise is just not because its the best L2 system, completely hands-free with no nags but the fact that its the only system that gives you a visual feedback, hap-tic feedback (vibrating seat), and audio message when it disengages.

Its really a no contest right now.

Here's a map of all supercruise mapped highways.

Cadillac Super Cruise
 
Last edited:

Randy Spencer

Active Member
Mar 31, 2016
3,281
3,168
Alameda, CA
Its really a no contest right now.

Here's a map of all supercruise mapped highways.

Cadillac Super Cruise

Crazy Cadillac fanboy cannot get anyone at a Cadillac site to listen to him? Sure am glad I have a Tesla that lets me activate auto pilot after leaving my driveway. I have that second set of eyes on my driving almost EVERYWHERE I go. No nags if I rest my hand on the wheel.

I really was motivated to get the Tesla to take care of our weekly drive to our cabin in the Sierras. Supercruise don't go there. Auto Pilot does 99% of that drive with a single disengagement and has improved over the months we have had the car with better and better driving. New updates every week or two.

-Randy
 

About Us

Formed in 2006, Tesla Motors Club (TMC) was the first independent online Tesla community. Today it remains the largest and most dynamic community of Tesla enthusiasts. Learn more.

Do you value your experience at TMC? Consider becoming a Supporting Member of Tesla Motors Club. As a thank you for your contribution, you'll get nearly no ads in the Community and Groups sections. Additional perks are available depending on the level of contribution. Please visit the Account Upgrades page for more details.


SUPPORT TMC
Top