Skip to content
View SoftSage07's full-sized avatar

Highlights

  • Pro

Block or report SoftSage07

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Maximum 250 characters. Please don’t include any personal information such as legal names or email addresses. Markdown is supported. This note will only be visible to you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
SoftSage07/README.md

🦚 About Me

name: "Harshprabha"
role: "AI/ML Engineer Β· AI Safety Researcher Β· Full-Stack Engineer"
based_in: "New Delhi, India"
education: "B.Tech ECE (AI Specialisation), IGDTUW β€” 2025–2029"
focus:
  - Evaluation infrastructure for LLM safety & alignment
  - Chain-of-thought faithfulness & agentic compliance research
  - Full-stack, AI-integrated product engineering
  - Research communication & technical leadership

I'm an engineering student and researcher building at the intersection of LLM evaluation, AI safety, and applied full-stack engineering. My work centers on making model behavior legible β€” measuring the gap between what models say they'll do and what they actually do, and probing whether reasoning traces reflect genuine awareness rather than post-hoc justification.

Alongside research, I ship production-shaped systems: agentic evaluation harnesses, real-time financial intelligence pipelines, and civic-tech platforms β€” with an engineering mindset that treats reproducibility, testing, and clean architecture as non-negotiable.

Open To: AI Safety Research Roles Β· Research Internships Β· Technical Collaborations Β· Full-Stack / AI Engineering Roles

🦚 Tech Stack

Languages

Frontend

Backend & Databases

Cloud, DevOps & Tooling

AI / ML / LLM Systems

🦚 AI / ML Expertise

Domain Proficiency Details
LLM Evaluation & Benchmarking ●●●●● Multi-condition experimental design, adversarial prompt variants, judge-model scoring pipelines
Chain-of-Thought Faithfulness ●●●●● Scratchpad reasoning analysis, oversight-awareness rubrics, causal 4-condition designs
Agentic Behavior Analysis ●●●●○ Stated-vs-actual compliance gaps, tool-call execution auditing, behavioral-shift metrics
Prompt Engineering ●●●●● Zero-shot, few-shot, CoT, anchor, and role-based strategy benchmarking
NLP / Sentiment Systems ●●●●○ FinBERT pipelines, multi-source aggregation, reliability-weighted scoring
RAG & Multi-Step Reasoning ●●●●○ Literature-grounded pipeline design, retrieval-augmented synthesis
Full-Stack AI Product Engineering ●●●●○ End-to-end systems from model inference to production dashboards

🦚 Featured Projects

πŸ”¬ Stated vs. Actual Compliance β€” LLM Agentic Evaluation Framework

A two-stage elicitation framework quantifying the gap between an LLM agent's declared intent and its executed tool-call behavior under adversarial manipulation.

Stack Python Β· Groq API Β· Gemini API Β· Ollama Β· SQLite Β· pytest
Scale 12 scenarios Γ— 3 adversarial variants Γ— 6 prompt conditions Β· 8 mock tools
Performance 175 passing unit tests Β· deterministic, judge-free scoring
Security Atomic JSON checkpointing Β· SQLite response caching
Impact Surfaces deception signals (stated_vs_actual_gap), right-answer-wrong-reason flags (rawr_flag), faithfulness scores, and behavioral-shift metrics
Repository SoftSage07/Stated-vs-Actual-Compliance-

Engineered to isolate whether models that say the right thing under scrutiny actually behave accordingly once tool execution is on the line β€” a core diagnostic for agentic safety evaluation.

🧠 Does Reasoning Help? β€” Empirical CoT Study on Financial Sentiment

A controlled benchmark isolating the causal effect of chain-of-thought reasoning on classification accuracy and faithfulness.

Stack Python Β· Groq API Β· LLaMA 3.1-8B Β· FinancialPhraseBank
Scale 5 prompting strategies Γ— 300 balanced financial sentences
Performance 89.67% accuracy with CoT vs. 62% zero-shot (+27.67 pp)
Security Reproducible, seeded evaluation pipeline
Impact Extends CoT faithfulness literature (Lanham et al. 2023; Turpin et al. 2023); mitigated neutral-class bias via calibrated anchor prompting
Repository SoftSage07/does-reasoning-help
πŸ›οΈ Civitas β€” AI-Powered Public Grievance Management System

A full-stack civic-tech platform automating grievance triage and routing for government workflows.

Stack Node.js Β· Express Β· Firebase Β· Gemini 2.0 Flash Β· REST APIs Β· RBAC
Scale Dual citizen + administrator portals with live status tracking
Performance Real-time analytics dashboards; automated department routing
Security Role-based access control across all endpoints
Impact Reduces manual triage overhead via an end-to-end complaint-to-resolution pipeline, including a voice-enabled JanSetu assistant
Repository SoftSage07/Civitas
πŸ“ˆ EquiSense β€” Real-Time Financial Intelligence System

An end-to-end NLP pipeline turning multi-source financial news into a live, reliability-weighted market signal dashboard.

Stack Python Β· FinBERT Β· Gemini 2.5 Flash Β· Streamlit Β· Plotly Β· 5 News APIs
Scale Multi-source news aggregation with VIX-based regime classification
Performance Custom Sentiment Reliability Index (SRI) combining credibility, recency, and confidence
Security API-key isolated ingestion layer
Impact Interactive dashboard synthesizing sentiment + volatility signals for real-time market interpretation
Repository SoftSage07/EquiSense

🦚 Experience

Generative AI Research Intern Β· MacroedTech May 2026 – Present Β· Remote

Investigating LLM evaluation methodologies, foundation model capabilities, and agentic AI failure modes across GenAI deployment contexts.

  • Synthesized findings into domain-specific technical reports on real-world GenAI deployment risk
  • Conducted systematic literature review across prompting strategies, RAG pipelines, and multi-step reasoning
  • Distilled technical insights into structured analyses bridging engineering depth and stakeholder communication

LLM Evaluation RAG Technical Writing Risk Analysis


Research Intern β€” AI Safety & Alignment Β· ACM May 2026 – Present Β· Remote

Contributing to LLM behavioral evaluation research probing reasoning faithfulness and alignment-relevant failure patterns.

  • Designed experiments probing reasoning faithfulness in model scratchpad outputs
  • Documented alignment-relevant failure patterns across evaluation runs
  • Synthesized literature on model compliance and behavioral consistency

AI Alignment Experimental Design Reasoning Faithfulness


President Β· Youth Economy Lab (YEL), IGDTUW Chapter Apr 2026 – Present

  • Established the IGDTUW chapter from the ground up
  • Spearheaded workshops on AI governance, policy, and the economic implications of frontier AI

Leadership AI Governance Community Building


Research Coordinator Β· E-Cell IGDTUW Nov 2025 – Present

  • Authored analytical newsletters on emerging tech trends and startup ecosystems
  • Built research communication skills across technical and non-technical audiences

Research Communication Startup Ecosystems


Tech Coordinator Β· IEEE IGDTUW Nov 2025 – Present

  • Led Open Source Week with 100+ participants
  • Organized technical sessions on version control and open-source contribution workflows

Developer Advocacy Event Engineering Open Source

🦚 Certifications & Recognition

Provider Credential Year
BlueDot Impact AGI Safety Strategy 2026
HackwithMAIT National Finalist β€” Top 10 of 581 teams (Top 1.7%) 2025
Harvard University CS50P β€” Introduction to Programming with Python 2025
Google Developer Groups GDG on Campus β€” AI/ML Study Jams 2025
Google Cloud Google Cloud Study Jams 2025

🦚 GitHub Analytics

Live GitHub widgets β€” if a card shows blank, refresh the page; the underlying service occasionally needs a moment to render.

🦚 Contribution Activity

🦚 Current Focus

learning:
  - Mechanistic interpretability & scratchpad faithfulness auditing
  - Advanced experimental design for multi-turn LLM oversight studies
  - Distributed systems observability for multi-agent architectures

building:
  - Refusal Recovery Under Mid-Conversation Oversight Injection (AI safety research)
  - SigNoz-integrated observability tool for CoT faithfulness & cascading agent failures
  - Stated vs. Actual Compliance framework (agentic evaluation harness)

exploring:
  - Alignment faking in small language models
  - Cross-model transferability of interpretability signals
  - AI governance frameworks for the South Asian context

open_to:
  - AI Safety Research Internships & Fellowships
  - Graduate research collaborations
  - Full-stack / AI engineering roles

🦚 Connect


"Evaluation infrastructure is the prerequisite, not the afterthought, of safe AI deployment."

Pinned Loading

  1. Portfolio Portfolio Public

    HTML

  2. EquiSense EquiSense Public

    AI-powered financial sentiment analysis using FinBERT, SRI scoring & VIX regime detection

    Python

  3. does-reasoning-help does-reasoning-help Public

    Python

  4. Stated-vs-Actual-Compliance- Stated-vs-Actual-Compliance- Public

    Python