ColombiAsk (Coming Soon!)
Developed a robust Query History Logger for ColombiAsk, a natural language interface for the CÓDIGO genetic variant database, to enable systematic benchmarking and performance auditing of LLM-generated queries. Using Python logging and json, the system captures a comprehensive audit trail of the Llama 3.1-driven pipeline, including generated PostgreSQL syntax, execution rationale, and retrieval metrics such as row counts and latency. This infrastructure is critical for delivering researcher-grade genomic insights, since it supports side-by-side accuracy comparisons across model scales (for example, 8B vs. 70B) and improves transparency for complex joins executed on Georgia Tech's PACE supercomputing cluster. By centralizing model configurations and SQL outputs into structured, date-stamped logs, I streamlined debugging for multi-turn SQL generation and created a scalable foundation for a known-good test set that ensures fully auditable interactions with high-stakes genetic data.