Skip to content

Branch 1 - #2131

Open
Krishnam24maheshwari wants to merge 9 commits into
datacommonsorg:masterfrom
Krishnam24maheshwari:branch_1
Open

Branch 1#2131
Krishnam24maheshwari wants to merge 9 commits into
datacommonsorg:masterfrom
Krishnam24maheshwari:branch_1

Conversation

@Krishnam24maheshwari

Copy link
Copy Markdown

No description provided.

Krishnam Maheshwari and others added 9 commits July 28, 2026 08:36
Added a newline at the end of the file for proper formatting.
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Added a robust session setup for HTTP requests with retries and connection pooling. Updated functions to utilize the new session for API calls.

@gemini-code-assist gemini-code-assist Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Code Review

This pull request refactors the Brazil SIDRA IBGE import script to fetch data directly via the IBGE REST API instead of using Selenium, adds validation configurations and golden data for both the Brazil SIDRA and US FARS crash datasets, and updates the US FARS crash data mappings to include 2024 data. Feedback on the changes suggests converting period IDs to strings to prevent comparison type errors, adding explicit guard checks for nested API responses to improve robustness, and raising an exception on critical failures in the main execution block to ensure automated pipelines fail loudly.

Comment thread statvar_imports/brazil_sidra_ibge/brazil_download_script.py
Comment thread statvar_imports/brazil_sidra_ibge/brazil_download_script.py
Comment thread statvar_imports/brazil_sidra_ibge/brazil_download_script.py
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant