Neural Nets to Be Used for Vehicle Control

Elon Musk has supplied additional steering on Tesla’s subsequent main launch of FSD Beta, v11.3. Last week Musk mentioned that v11.3 could be prepared in about ‘two weeks’ and would include many main enhancements.

We’ve heard these two-week estimates earlier than, but it surely’s reassuring that Musk is being particular with particulars on this upcoming launch.

Now simply seven days after his final tweet, Elon Musk is giving us extra particulars on this important improve.


Musk mentioned he expects FSD Beta v11.3 to begin rolling out to some prospects later this week, or subsequent week on the newest. This matches up along with his preliminary two week estimate per week in the past.

Elon Musk’s estimates are identified to be overly optimistic, however given the variety of particulars he is releasing, it appears like Tesla could also be shut to releasing this subsequent construct.

FSD Beta v11.3 will seemingly roll out to Tesla workers first after which exit to choose FSD Beta testers, probably the unique OG group. Since it is a main milestone and contains main enhancements, count on a sluggish and gradual rollout. Although we could get our first glimpse into FSD Beta v11 this week, it could be a number of weeks or extra earlier than the vast majority of prospects have entry to this beta.

Neural Nets for Vehicle Behavior

Per week in the past Musk mentioned this improve will embody ‘many main enhancements.’ Last night time Musk revealed some further particulars. He mentioned there might be “many small issues,” one in all which might be that Tesla will start to use neural nets for automobile navigation and management, as an alternative of simply imaginative and prescient.

Today Tesla makes use of neural networks to decide the automobile’s environment, the place objects are, what they’re, and their distances from the automobile to create a 3D surroundings often called ‘vector area.’ With this info, the automobile can then plan a path and navigate round these objects in the direction of its vacation spot.

However, based mostly on Musk’s remark, it appears like Tesla is presently solely utilizing neural nets to decide its surroundings and never for controlling the automobile. This signifies that how the automobile behaves, the way it finds a path, and the way it strikes remains to be a course of that’s coded historically.

In the identical manner that Tesla makes use of thousands and thousands of photos to decide what a cease signal or site visitors cone is, it appears like Tesla will now use a lot of examples to decide how to greatest management the automobile in numerous conditions.

That might imply that Tesla will take thousands and thousands of high quality examples of how to progressively speed up or decelerate, based mostly on actual driving conduct to decide how the automobile ought to speed up in numerous conditions.

This may very well be utilized to each driving attribute similar to turning, sluggish downing, driving round a parked automobile, and so on.

If Tesla begins leveraging neural nets to support automobile management we could quickly see drastic enhancements to automobile conduct, making it a lot smoother and human-like.

New Features

Although Elon Musk didn’t particularly point out new options coming to FSD Beta v11.3, there are a number of which were talked about previously that might present up on this main full self-driving replace.

Reverse Creep

Reverse Creep has been a characteristic that has been talked about way back to FSD Beta 10.13. This characteristic would enable the automobile to backpedal to transfer out of the best way of hazard or modify its trajectory. Right now FSD Beta will solely ever transfer ahead, so this enchancment could be an enormous step in the direction of reaching human-like conduct.

A superb use case for that is when the automobile strikes ahead for higher visibility. There could also be occasions when the automobile sees a automotive coming after transferring creeping ahead. In these instances, it would be sensible to let the automobile reverse again to its earlier place whether it is now within the path of site visitors.

Navigating Without Map Data & GPS

In the previous Musk additionally alluded to the truth that Tesla is engaged on the neural networks’ potential to full ‘useless reckoning’ navigation, which is navigating based mostly solely on inertial measurements similar to velocity, path and wheel motion.

He gave underground parking garages for example of the place FSD would want the flexibility to navigate with out GPS or map knowledge.

The automotive might be in a position to do that through the use of its final identified GPS location after which decide its future location utilizing solely a compass, wheel motion and velocity.

FSD Beta v11

FSD Beta v11 has at all times been anticipated to be a giant leap ahead, and as we get nearer, that hasn’t modified. This replace is anticipated to be an enormous enchancment to what’s presently out there to prospects. Although Musk’s timelines have often shifted and options have usually taken longer than initially deliberate, it appears to be like like we could also be getting shut to the subsequent main launch for FSD Beta.

Although we’re nonetheless years away from true full self-driving, Tesla’s mission inches nearer with each replace.

Recently there was additionally a leak revealing some particulars of Tesla’s upcoming cameras in {hardware} 4.0, that are anticipated to embody a fan and heater for chosen cameras.

Sonic The Hedgehog is returning to Teslas

One of our discussion board customers, Thib, confirmed with Tesla Service that the beloved Sonic The Hedgehog recreation might be returned to Tesla autos.

According to Tesla Service, the sport was solely underneath a “short-term suspension.” The service consultant goes on to state: “Indeed, this recreation is presently suspended, will probably be re-integrated quickly.”

Tesla added the Sonic recreation to its autos throughout the 2021 vacation replace. It was solely out there for a 12 months earlier than Tesla eliminated it within the 2022 vacation replace. The recreation requires a USB controller to play.

Early final 12 months, Tesla added Sonic to autos that didn’t have data-capable USB ports within the entrance through the glovebox. Version 2022.28.1 launch notes learn, “A recreation controller plugged into the glovebox USB port is required.”

Sonic the Hedgehog is a platform online game that was launched in 1991 by Sega for their Genesis gaming system. Players management a blue hedgehog, named Sonic, to run at quick speeds on a mission to overtake Dr. Robotnik, a mad scientist who has locked away animals inside robotic our bodies whereas chasing after the Chaos Emeralds.

The removing of Sonic the Hedgehog remains to be unclear, however we’re speculating that it had to do with a bug or the license expiring.

Tesla additionally added Steam to a number of of its autos, which indicators that they might be transitioning away from including extra video games. Instead, they will depend on Steam’s huge catalog of video games for customers to take pleasure in. Tesla could merely transition into ensuring Steam is working easily on its working system.

New information is leaked about Tesla's upcoming hardware 4.0 suite

We now have new info concerning Tesla’s up to date cameras that might be utilized in Hardware 4.0. Twitter consumer @ChrisZheng001, who has ties with the Tesla provide chain in China, posted three photos that seem to be digicam configurations. While the knowledge within the image is proscribed, there may be sufficient textual content to uncover what could also be in growth at Tesla.

Three Cameras to Two

The front-facing cameras will be reduced to two

Perhaps the largest change comes to the trio of cameras that make up the forward-facing view for the Autopilot system. The translation seems to state that Tesla might be decreasing its three front-facing cameras down to two and all cameras, together with the inside digicam, might be upgraded to ‘AP4’ cameras. The newer cameras are anticipated to have a a lot increased decision as well as to different enhancements similar to LED flicker mitigation.

The solely info supplied by @ChrisZheng001 within the publish: The Autopilot HW 4.0 entrance digicam might be lowered to two Cz (due to the numerous improve in each pixel density and subject of view).

In November of 2022, it was revealed {that a} Tesla provider was producing 5-megapixel cameras. The present cameras are 1.2 megapixels. So, whereas the variety of cameras is being lowered, Tesla Vision will truly enhance.

Fans for Forward Facing Cameras

The front-facing cameras will feature a fan to help with condensation

That leads to the subsequent change. The housing dimension doesn’t seem to change, simply what’s in it. According to the doc, and once more utilizing Google translate, it states: the form of the black border on the place of the entrance digicam has modified/added a digicam fan.

By that wording, it appears like the brand new housing will embody a fan, seemingly to stop condensation buildup. However, it appears open for change with a window for suggestions and additional analysis.

B-Pillar Changes

B-pillar cameras will gain a heater in addition to a new camera opening

There is yet another image. The textual content reads: B-pillar exterior trim. B-pillar exterior panel digicam change, opening form change, new digicam heating gadget. Inspection station: remaining care exterior ornament inspection look; heating perform might be evaluated after venture suggestions.

There isn’t a lot to determine on the market. Tesla seems to be including a heating gadget to maintain the B-pillar cameras clear and altering the form of the opening. That may very well be due to the dimensions of the brand new cameras or the sector of view they require.

It’s extensively speculated {that a} new high-resolution radar unit is within the works. That radar mixed with these high-powered cameras means Tesla’s already unbelievable Autopilot system will solely enhance.


Leave a Comment