name: "Harshprabha"
role: "AI/ML Engineer Β· AI Safety Researcher Β· Full-Stack Engineer"
based_in: "New Delhi, India"
education: "B.Tech ECE (AI Specialisation), IGDTUW β 2025β2029"
focus:
- Evaluation infrastructure for LLM safety & alignment
- Chain-of-thought faithfulness & agentic compliance research
- Full-stack, AI-integrated product engineering
- Research communication & technical leadershipI'm an engineering student and researcher building at the intersection of LLM evaluation, AI safety, and applied full-stack engineering. My work centers on making model behavior legible β measuring the gap between what models say they'll do and what they actually do, and probing whether reasoning traces reflect genuine awareness rather than post-hoc justification.
Alongside research, I ship production-shaped systems: agentic evaluation harnesses, real-time financial intelligence pipelines, and civic-tech platforms β with an engineering mindset that treats reproducibility, testing, and clean architecture as non-negotiable.
Open To: AI Safety Research Roles Β· Research Internships Β· Technical Collaborations Β· Full-Stack / AI Engineering Roles
| Domain | Proficiency | Details |
|---|---|---|
| LLM Evaluation & Benchmarking | βββββ | Multi-condition experimental design, adversarial prompt variants, judge-model scoring pipelines |
| Chain-of-Thought Faithfulness | βββββ | Scratchpad reasoning analysis, oversight-awareness rubrics, causal 4-condition designs |
| Agentic Behavior Analysis | βββββ | Stated-vs-actual compliance gaps, tool-call execution auditing, behavioral-shift metrics |
| Prompt Engineering | βββββ | Zero-shot, few-shot, CoT, anchor, and role-based strategy benchmarking |
| NLP / Sentiment Systems | βββββ | FinBERT pipelines, multi-source aggregation, reliability-weighted scoring |
| RAG & Multi-Step Reasoning | βββββ | Literature-grounded pipeline design, retrieval-augmented synthesis |
| Full-Stack AI Product Engineering | βββββ | End-to-end systems from model inference to production dashboards |
π¬ Stated vs. Actual Compliance β LLM Agentic Evaluation Framework
A two-stage elicitation framework quantifying the gap between an LLM agent's declared intent and its executed tool-call behavior under adversarial manipulation.
| Stack | Python Β· Groq API Β· Gemini API Β· Ollama Β· SQLite Β· pytest |
| Scale | 12 scenarios Γ 3 adversarial variants Γ 6 prompt conditions Β· 8 mock tools |
| Performance | 175 passing unit tests Β· deterministic, judge-free scoring |
| Security | Atomic JSON checkpointing Β· SQLite response caching |
| Impact | Surfaces deception signals (stated_vs_actual_gap), right-answer-wrong-reason flags (rawr_flag), faithfulness scores, and behavioral-shift metrics |
| Repository | SoftSage07/Stated-vs-Actual-Compliance- |
Engineered to isolate whether models that say the right thing under scrutiny actually behave accordingly once tool execution is on the line β a core diagnostic for agentic safety evaluation.
π§ Does Reasoning Help? β Empirical CoT Study on Financial Sentiment
A controlled benchmark isolating the causal effect of chain-of-thought reasoning on classification accuracy and faithfulness.
| Stack | Python Β· Groq API Β· LLaMA 3.1-8B Β· FinancialPhraseBank |
| Scale | 5 prompting strategies Γ 300 balanced financial sentences |
| Performance | 89.67% accuracy with CoT vs. 62% zero-shot (+27.67 pp) |
| Security | Reproducible, seeded evaluation pipeline |
| Impact | Extends CoT faithfulness literature (Lanham et al. 2023; Turpin et al. 2023); mitigated neutral-class bias via calibrated anchor prompting |
| Repository | SoftSage07/does-reasoning-help |
ποΈ Civitas β AI-Powered Public Grievance Management System
A full-stack civic-tech platform automating grievance triage and routing for government workflows.
| Stack | Node.js Β· Express Β· Firebase Β· Gemini 2.0 Flash Β· REST APIs Β· RBAC |
| Scale | Dual citizen + administrator portals with live status tracking |
| Performance | Real-time analytics dashboards; automated department routing |
| Security | Role-based access control across all endpoints |
| Impact | Reduces manual triage overhead via an end-to-end complaint-to-resolution pipeline, including a voice-enabled JanSetu assistant |
| Repository | SoftSage07/Civitas |
π EquiSense β Real-Time Financial Intelligence System
An end-to-end NLP pipeline turning multi-source financial news into a live, reliability-weighted market signal dashboard.
| Stack | Python Β· FinBERT Β· Gemini 2.5 Flash Β· Streamlit Β· Plotly Β· 5 News APIs |
| Scale | Multi-source news aggregation with VIX-based regime classification |
| Performance | Custom Sentiment Reliability Index (SRI) combining credibility, recency, and confidence |
| Security | API-key isolated ingestion layer |
| Impact | Interactive dashboard synthesizing sentiment + volatility signals for real-time market interpretation |
| Repository | SoftSage07/EquiSense |
Generative AI Research Intern Β· MacroedTech
May 2026 β Present Β· Remote
Investigating LLM evaluation methodologies, foundation model capabilities, and agentic AI failure modes across GenAI deployment contexts.
- Synthesized findings into domain-specific technical reports on real-world GenAI deployment risk
- Conducted systematic literature review across prompting strategies, RAG pipelines, and multi-step reasoning
- Distilled technical insights into structured analyses bridging engineering depth and stakeholder communication
LLM Evaluation RAG Technical Writing Risk Analysis
Research Intern β AI Safety & Alignment Β· ACM
May 2026 β Present Β· Remote
Contributing to LLM behavioral evaluation research probing reasoning faithfulness and alignment-relevant failure patterns.
- Designed experiments probing reasoning faithfulness in model scratchpad outputs
- Documented alignment-relevant failure patterns across evaluation runs
- Synthesized literature on model compliance and behavioral consistency
AI Alignment Experimental Design Reasoning Faithfulness
President Β· Youth Economy Lab (YEL), IGDTUW Chapter
Apr 2026 β Present
- Established the IGDTUW chapter from the ground up
- Spearheaded workshops on AI governance, policy, and the economic implications of frontier AI
Leadership AI Governance Community Building
Research Coordinator Β· E-Cell IGDTUW
Nov 2025 β Present
- Authored analytical newsletters on emerging tech trends and startup ecosystems
- Built research communication skills across technical and non-technical audiences
Research Communication Startup Ecosystems
Tech Coordinator Β· IEEE IGDTUW
Nov 2025 β Present
- Led Open Source Week with 100+ participants
- Organized technical sessions on version control and open-source contribution workflows
Developer Advocacy Event Engineering Open Source
| Provider | Credential | Year |
|---|---|---|
| BlueDot Impact | AGI Safety Strategy | 2026 |
| HackwithMAIT | National Finalist β Top 10 of 581 teams (Top 1.7%) | 2025 |
| Harvard University | CS50P β Introduction to Programming with Python | 2025 |
| Google Developer Groups | GDG on Campus β AI/ML Study Jams | 2025 |
| Google Cloud | Google Cloud Study Jams | 2025 |
Live GitHub widgets β if a card shows blank, refresh the page; the underlying service occasionally needs a moment to render.
learning:
- Mechanistic interpretability & scratchpad faithfulness auditing
- Advanced experimental design for multi-turn LLM oversight studies
- Distributed systems observability for multi-agent architectures
building:
- Refusal Recovery Under Mid-Conversation Oversight Injection (AI safety research)
- SigNoz-integrated observability tool for CoT faithfulness & cascading agent failures
- Stated vs. Actual Compliance framework (agentic evaluation harness)
exploring:
- Alignment faking in small language models
- Cross-model transferability of interpretability signals
- AI governance frameworks for the South Asian context
open_to:
- AI Safety Research Internships & Fellowships
- Graduate research collaborations
- Full-stack / AI engineering roles