Two great videos were posted on Friday and it has been really enjoyable listening to them over the weekend.
First up was Dave Lee (
@DaveT ) interviewing James Douma (
@jimmy_d ). James has a great way of focussing on (and explaining) the key trends. Hugely informative - many thanks to you both.
Earlier posters have complained that they found Lex Fridman's second interview of Jim Keller difficult to get into. It is perhaps a bit more nerdy, assuming a grounding in the hardware and software developments related to high performance computing, but after some of the more philosophical (?) musings it really takes off after 50 minutes with some incredibly insightful to and fro. As someone that was heavily involved in writing engineering software to run on high performance architectures early in my career, I found it a joy to listen to someone at the top of the game talking about future directions. The fire still burns bright in Jim!
The 'graph' architectures discussed will aid AI progress but variants will also be applicable to lots of classic scientific problems requiring matrix solution. Incredibly exciting.
My takeaway from both of these talks? The Tesla AI team (and others working on autonomous driving) are operating on the leading edge of these technologies. The problem is not solved yet, but these guys are moving forward and dealing with the problems as they arise. Things are perhaps going slower than hoped, but it is just a question of time. Being in the UK, where it looks like I will have to wait until '22 to be able to buy a Y (or S/X) I am just hoping it is all sorted by then
Hope you all had a good weekend, and especially hope any guys in Texas are staying safe in the bad conditions.