Week notes — 12th September 2024I’ve started going through Brunton & Kutz’s Data Driven Science and Engineering book, taught as a series of YouTube lectures. I still have…Sep 12, 2024Sep 12, 2024
Week notes — 5th September 2024I’ve finished the lectures for Stanford’s Deep Learning for Natural Language Processing course. The program also requires a final project…Sep 5, 2024Sep 5, 2024
What if Apple made an eBike?The rules of the game are as follows: you are a designer at Apple working on a project to build a bike that appeals to the company’s…Aug 31, 2024Aug 31, 2024
Week notes — 15th August 2024Cooperative AI & Agents Last week I started thinking about how the classic HCI concept of ‘task’ applies to AI agents. The week before I…Aug 15, 2024Aug 15, 2024
Week notes — 10th August 2024— Started the week by getting through 3 lectures from the CS224N course. On the one hand, they are hard work, on the other… you do the…Aug 10, 2024Aug 10, 2024
Tasks, Actions & AgentsIn a pervious post, I looked at Google’s “Unsolved problems in cooperative AI” paper. It’s an incredibly expansive paper, drawing all kinds…Aug 10, 2024Aug 10, 2024
Notes on DeepMind’s ‘Open Problems in Cooperative AI’ paperI’ve been thinking about how RAG-based ‘chatbots’ might work in built environment planning, specifically looking at the planning system in…Jul 25, 2024Jul 25, 2024
Week notes — 23rd July 2024→ Continuing the CS224d Course, where I have one assignment and about 8 lectures left. I’m using the 2023 course, which is available for…Jul 23, 2024Jul 23, 2024
Week notes — 10th July 2024This week I’ve been looking at the idea of AI Agents — that is, AIs that are able to interact with the outside world (exact definitions…Jul 16, 2024Jul 16, 2024
Week notes — 10th July 2024This week I wrote up some back-of-the-envelope thoughts about how many people are using GenAI, prompted by the range of exposure I’ve…Jul 10, 2024Jul 10, 2024
Week notes — 4th July 2024It’s not been a big week for research and learning — I’ve been away.Jul 4, 2024Jul 4, 2024
How widespread is GenAI use?TL;DR: very very roughly, triangulating from multiple datasets suggests around 25% of adults under 70 in the UK are somewhat regularly…Jul 4, 2024Jul 4, 2024
Week notes — 25th June 2024A little placeholder — some personal events have disrupted my Weeknoting cadence… including missing one last week — normal service to…Jun 25, 2024Jun 25, 2024
New research is beginning to unravel how LLMs think. What are the practical consequences?Anthropic and OpenAI have recently published research focused on understanding how their LLMs (Claude & ChatGPT) work. This post describes…Jun 16, 2024Jun 16, 2024
Week notes — 12th June 2024This week I have been taking Stanford’s CS224d: Deep Learning for Natural Language Processing course.Jun 12, 2024Jun 12, 2024
Week notes — 5th June 2024This week I looked at topic modelling for neighbourhood plans, following on from my previous work building an interface to query them.Jun 4, 2024Jun 4, 2024
Week notes — 29th May 2024Having done quite a bit of personal exploratory work on Local Plans, I’ve realised they are not the most fertile area for me to work on, at…May 29, 2024May 29, 2024
Week notes — 21st May 2024To recap from the last couple of weeks: I’m interested in how LLM’s semantic understanding of unstructured text might be used to help users…May 21, 2024May 21, 2024
Why are LLMs great at some complex tasks while failing on other apparently simple problems?It’s hard to develop intuitions about what LLMs can and can’t do. Why are they successful at some complex tasks only to fail at other…May 20, 2024May 20, 2024