Udayan Kumar My public notes

Small Models, Big Savings!

Small language model cost calculator

TL;DR: For narrow, repetitive NLP tasks at high volume, a small fine-tuned model can be much cheaper (10x is possible) than a frontier LLM. The savings can be large, but mostly when the task is constrained & frequent enough to justify the extra engineering work.

Prompts vs. Code: The Cost of No Compiler

Scattered prompt instructions contrasted with organized compiler-checked code

Alaska trip

TL;DR: Alaska trip log by my mom in Hindi

Measuring Success in data Science

TL;DR: Success in data science is inversely proportional to the number of times the same steps are repeated.

Working with a Neato Lidar

help A lidar measures distance to the nearest object in-front of the sensor. For e.g., a lidar mounted on a robot can be used to detect obstacles in the path. A lidar is more expensive but provides better accuracy and range than other methods such as ultrasonic sensors when measuring distance. In my effort to build an autonomous car, I chose to use a Neato robovaccum lidar - XV-11. In this post I am writing down my experiences of working with it.