In this engaging 25-minute talk, we delve into the world of large language models (LLMs) specifically designed for source code. We highlight the importance of open-source models for safeguarding privacy, and provide a comprehensive overview of the current state of the art in LLMs.

We then introduce SantaCoder, an open-source LLM for code generation, and demonstrate how it can be fine-tuned for the downstream task of bug fixing, resulting in the SantaFixer model. Trained on a dataset of single-line Common Vulnerabilities and Exposures (CVE) fixes, SantaFixer can generate bug fixes using code inlining.

But that's not all! We unveil an exciting new open-source tool called AutoFix, which combines static analysis with LLM capabilities to automatically detect and fix software vulnerabilities. We showcase the capabilities of AutoFix in action, highlighting its potential to improve overall code quality.

Best of all, SantaFixer and AutoFix are both released under the Apache license, making them accessible to the wider open-source community. Join us as we explore the cutting-edge world of open-source LLMs and their transformative impact on the future of software development.

Rohan Sood
COO, Scantist
Passionate about web development and the capabilities of big data. Self-taught web-developer. Optimization fanatic. Cybersecurity and open-source enthusiast.

Asankhaya Sharma
CTO, Securade.ai
Dr. Asankhaya Sharma is the co-founder and Chief Technology Officer at Securade.ai, a deep-tech startup with the vision to make the world a safer place. Dr. Sharma is a well known technology expert, author, and public speaker. He has more than 15 years of experience in the technology and software development fields holding technical leadership roles at startups and large enterprises.

Prior to Securade.ai he was the global director of innovation and incubation at Veracode, an application security company. Before that, he was the head of R&D at SourceClear (acquired by CA Technologies in 2018), the first software security company focussed on open-source security and software supply chain.

He has a PhD in Computer Science from the National University of Singapore (NUS) and is currently an Adjunct Professor at the Singapore Management University (SMU).