Python Summit - Is Python the favorite language of LLMs?

Announcement, slides, and recording. You can also find my writeup of the talk here. All resources can also be found in my archive.

At the Python Summit I dug into a little known research area: LLM's biases for programming languages. Is it true that your LLM will choose Python no matter the task you give it, or that it's more proficient at coding in Python than in any other language? Should you be concerned about this issue, or is it just a harmless preference? And where did this "problem" come from in the first place?

Turns out there is a decent amount of published research on this topic, and various benchmarks that track the current situation.