S5. Self-driving cars, humanoid robots and AI assistive technology and more

skip to Session 6 - AI Ethics

Session 5 - Outline for Students

A. Self-driving Cars arrive

Self-driving cars are the most visible example of a mechanical device being given intelligence by AI. This session examines just how close they are and then shows how the same underlying logic extends to humanoid robots and even to AI Assistive Technology.

A1. Video in, action out (Tesla example). Also known as "Photons in, controls out". For many years it seemed that achieving Full Self Driving (FSD) was far more difficult than had been hoped. Traditional programming techniques just could not deal with all of the millions of 'edge cases' - that is, the rare situations that were different to just proceeding down a well lit road with clear lane markings. Then, everything changed. Elon Musk and his team realised that they could train a neural net on the hundreds of million hours of videos that existing Tesla cars on the road recorded. Of course, that took immense computing power but the result was that thousands of lines of 'old style' code could be discarded.

The first view of the Tesla Robotaxi on 10th October 2024. Tesla's "We, Robot" event showed 19 Cybercabs and 29 Model Ys driving themselves on 1,300 trips transporting over 2,000 guests

Rides in the city of the future https://t.co/swCCGwLP1X pic.twitter.com/mu5IfQD6AN

— Tesla (@Tesla) October 17, 2024

Below is video of FSD in Dec. 2024.


Here's Tesla FSD 13.2 driving for an hour and 40 minutes through LA traffic with zero interventions.

I know watching a video of my car sitting in traffic may not be very exciting, but imagine what a life changer this is for people who do this commute every day. pic.twitter.com/rVl8qDOzYe

— Whole Mars Catalog (@WholeMarsBlog) December 8, 2024

Below is an example of the stage of FSD early July 2024. Palo Alto to San Francisco


Look back to FSD at around April 2024. Bear in mind though that updates now arrive once every two weeks or so!




This one is May 2024 on small roads.




Most recent versions of Tesla's 'self driving' car are generally agreed to be superior to the old. This has also given a major headache to many Tesla competitors who do not possess hundreds of millions of hours of driving video to use for AI learning. How then can they train their own systems? It is suggested that many are likely to have to license the technology from Tesla. [disclaimer: the writer owns Tesla shares]



B. There will soon be many Humanoid Robots

The development of humanoid robots has happened very slowly over many years. Suddenly however they are about to appear in many areas of our lives in quite a shocking fashion. The reason is of course the power of AI which has allowed robots to learn how to relate to the world in a way that was never previously possible.


A Tesla Optimus training on rough ground.

luckily i downloaded it@M_IsForMachine 👀 pic.twitter.com/O4ctDu4OIv

— Jacob (@TPaintjob) December 9, 2024

B1. Humanoid robots learn quickly. Things moved quickly in 2024. Dexterity that used to be achieved only after years of careful engineering now appears almost as a side benefit of training. So it becomes only a matter of time until humanoid robots appear in our midst.

The following clip is of an Optimus being tele-operated and shows that Optimus will be able to participate in a wide range of activities. It has been suggested that remote tele-operation of humanoid robots will continue to be useful long after the internal AI can perform tasks without asistance.

Got a new hand for Black Friday pic.twitter.com/x3gQrsbYAQ

— Tesla Optimus (@Tesla_Optimus) November 28, 2024

B2. The initial uses. We know that the initial applications will be the 'low hanging fruit' in business. For example:

- warehouse and shop workers carrying boxes and unloading and loading vehicles

This is AI created, yet it will soon be seen on every street.

Imagine seeing the $TSLA BOT at the mall like this 😯 pic.twitter.com/ji5tKR5126

— Pejjy (@CuriousPejjy) November 26, 2024

- production line work bringing parts to the line and more - shop workers restocking shelves and giving excellent customer service
- car to home delivery once self driving vans are commonplace

Here is a useful cable TV news video from July 2024.


So, business and industrial applications will provide the volumes, and that in turn will ensure fast cost reduction. Further down this page we examine some of the main suppliers. As might be expected, this is a very competitive market. Recent price prediction for robots for personal use are in the £ 10,000 to £20,000 range, comparable to a small car. Another interesting prediction was that within 10 years there would be more Humanoid Robots than SmartPhones.



B3. Longer term applications.

Example: Robots as personal trainers. It will be a while until the ordinary home has a full power humanoid robot but we can examine one area where they become directly useful to ordinary citizens. In the UK a personal trainer might cost, say, £ 20 per hour. Please don't complain if you live in a higher cost area, this figure will do for our purposes.

Runner out with her humanoid robot trainer

Imagine then that a local company hires a 'personal trainer robot' and then rents it out to clients who wish company and security when running, as well of course as a fully informed guide with knowledge of all your vital signs. That also has to be worth £ 20 per hour to many end users. Doing some basic mathematics, and assuming a modest capacity of 30 hours per week then the business can produce an income of £ 600 per week, or £ 30 000 per annum.

Suppliers of humanoid robots will almost certainly wish to rent them out to the business, complete with insurance and maintenance, rather than sell them outright. Potentially then even an annual rental cost of £ 20 000 might make everybody's calculation work. Given the competition levels, this is not a hard price to anticipate being reached very soon.



Example: Humanoid robots as carers. For a robot to provide assistance in a person's home, or in a care home, it needs to be able to move fluidly in the same complicated spaces that humans manage every day. That means that it is very likely to be a robot in humanoid form that provides the solution to this difficult problem.

Runner acting as a carer

Why robots rather than people? Clearly there will still be a need for people to work as carers whatever happens with humanoid robots. The best of the latter will have some advantages though.
- potentially available 24 hours a day, seven days a week

- able to monitor vital signs automatically
- with powerful 'consultant level' diagnostic skills
- strong enough to lift a patient on their own
- fully recorded actions by camera and sensors

As with all 'products' the quality of the humanoid robot will depend on budget available and cultural decisions. They should revolutionise care surprisingly soon though in more affluent countries.



B4. The many suppliers of humanoid robots.

This section is intended to show the wide range of companies who are competing to be major players in this space. It also demonstrates how far advanced the leading players are. It really won't be long until we see humanoids competing in the 'Robot Olympics'!

a. Optimus Generation 2. This humanoid robot is from USA based Tesla tesla.com humanoid robot in a video from January 2024. Notice the aspects that they highlight in their on-screen comments. Things like walking speed are vital for any industrial robot in general application. If your job is to fetch a part and bring it to the line, you need to do it as fast as a human could.




b. Figure robot now using OpenAI intelligence. Made by USA company Figure figure.ai. This video from March 2024 shows a humanoid robot in conversation about a task before selecting the correct item and moving it as requested.




c. Digit. Made by USA based Agility Robotics agilityrobotics.com. This video from April 2024 shows a field trial of their robot in an industrial setting. View their other videos for a range of industrial placements.




d. Unitree H1. Chinese company Unitree unitree.com have an impressive offering. This May 2024 video mentions a price from USD16,000 and showcases dexterity and mobility. As in the 'Electric car' market, China will quickly drive down the cost of humanoids.




e. 1X Eve and Neo. This Norwegian company 1X 1X.tech is aiming at both the industrial and home markets. The video is from April 2024 and shows wheeled robot Eve unpacking shopping in a home environment.




f. Sanctuary AI Phoenix Sanctuary AI sanctuary.ai offer a humanoid general purpose robot called Phoenix. This video is from April 2024 showing that robots will start to move at human speed - and beyond.



C. Drones and Drone Swarms

C1. It is no longer easy to define a 'drone' as they are taking on many forms and are being combined with both centrally controlled AI and with their own intelligence. The most obvious are the drones that are used in entertainment, warfare and more mundane delivery and surveillance tasks. Here is a drone exercise in China with obvious dual use potential.

When I talk about coordinated drone swarms, this is what I mean pic.twitter.com/DZC2bkPVSP

— Adrian Dittmann (@AdrianDittmann) November 24, 2024

C2. Palantir CEO Alex Karp is at the forefront of using AI in conflict as well as in more peaceful situations (like the UK's NHS). Note the references to Ukraine and Israel. Apparently "human ethics can be encoded" which sounds reassuring ...

$PLTR AI and Ethics: The Future of Battlefield Intelligence with Palantir CEO Alex Karp on FOX News: pic.twitter.com/a4G5jNqftc

— Palantir Daily (@DailyPalantir) December 10, 2024

D. AI Agents are widely available from early 2025

An 'AI Agent' is an AI that has been given the permissions and knowledge to control a computer, much as a human does. That is potentially a great help and also has many dangers.

Here is a simple example where you give your AI Agent a list of company names in a Google spreadsheet and it goes off and browses the web to get matching contact email addresses. Limitless potential (and dangers). More at Google Blog on Gemini 2.0 Flash including "Unlocking agentic experiences with Gemini 2.0".

Google just unveiled a new project that shows how AI Agents are coming for full browser and computer use. This opens up AI to any of the laborious knowledge tasks that we do today. Most importantly, it lets us automate work that we never had even contemplated before. pic.twitter.com/xLauJhZnr9

— Aaron Levie (@levie) December 11, 2024

E. The Urgency of AI Assistive Technology

AI will soon also gives unprecedented support to disadvantaged members of society. It would be unforgiveable if the quality of so many lives could be dramatically improved by technology but then years are lost due to slow rollout and a lack of incentives for the suppliers. There are separate pages for different aspects. This is an area we are actively researching, looking for ways to aid our local community. Some of the pages are still 'works in progress'.


Neuralink Blindsight

Neuralink is an Elon Musk company which has already performed an operation that gave a man with complete paralysis below the neck the ability to confidently control a computer with full functionality. Here is more of their direction.

We have received Breakthrough Device Designation from the FDA for Blindsight.

Join us in our quest to bring back sight to those who have lost it. Apply to our Patient Registry and openings on our career page https://t.co/abBMTdv7Rh

— Neuralink (@neuralink) September 17, 2024

Interesting news that Neuralink has opened a UK patient registry, so pass the news if you know anybody suffering from relevant issues (see below). Weblink here: neuralink.com/patient-registry/uk/ .

"Anyone within the UK who is at least 18 years old, who is able to consent, and who has quadriplegia, paraplegia, vision loss, hearing loss, the inability to speak, and/or major limb amputation (affecting above or below the elbow and/or above or below the knee), is invited to participate in the Patient Registry UK"


Neuralink UK Patient registry

AI to aid those with Sight Issues

AI to aid those with Memory Issues