Skip to content

Add agent files to DABs templates#5996

Open
lennartkats-db wants to merge 9 commits into
mainfrom
agent-files-in-template
Open

Add agent files to DABs templates#5996
lennartkats-db wants to merge 9 commits into
mainfrom
agent-files-in-template

Conversation

@lennartkats-db

Copy link
Copy Markdown
Contributor

Changes

Add an AGENTS.md to the bundle templates (default, default-scala, default-sql, dbt-sql, plus the templates that reuse default). It points coding agents at Databricks AI Tools: read the databricks-core skill first, and install via databricks aitools install if it's missing. A one-line CLAUDE.md includes it via @AGENTS.md.

Why

We'd like to help AI agents in new projects via Databricks AI Tools.

Tests

Regenerated the template acceptance goldens; task test-update-templates passes.

Generated DAB projects now include an AGENTS.md with project layout,
the common bundle CLI workflow (validate/deploy/run/summary), and
conventions, plus a CLAUDE.md that imports it via @AGENTS.md so Claude
Code and tools using the AGENTS.md convention share one source of truth.

Added to the default, default-sql, default-scala, and dbt-sql template
bodies, which covers all built-in templates (default-python,
default-minimal, lakeflow-pipelines, and pydabs share the default body).

Co-authored-by: Isaac
…templates

Update the remaining template files that referred to the product by its
former name: the databricks.yml header comments (default, default-sql,
default-scala bodies), the dbt_project.yml comment, and the
default-minimal welcome message.

Co-authored-by: Isaac
Replace the verbose per-template AGENTS.md with the short version
originally used in experimental/aitools (removed in c8d825c): point
agents at the databricks skill, explain how to install agent skills
(databricks aitools install), and leave a placeholder for
project-specific instructions. Inlining all instructions is a non-goal.

Co-authored-by: Isaac
Reword the section to "Use the Databricks Agent Skills": read the core
databricks skill, reach for the product skills it links to
(databricks-jobs, databricks-pipelines, databricks-apps), and install
them with databricks aitools install. Regenerate template goldens.

Co-authored-by: Isaac
# Conflicts:
#	acceptance/bundle/templates/default-minimal/output.txt
#	acceptance/bundle/templates/default-minimal/output/my_default_minimal/databricks.yml
#	acceptance/bundle/templates/default-python/classic/output/my_default_python/databricks.yml
#	acceptance/bundle/templates/default-python/serverless/output/my_default_python/databricks.yml
#	acceptance/bundle/templates/default-scala/output/my_default_scala/databricks.yml
#	acceptance/bundle/templates/default-sql/output/my_default_sql/databricks.yml
#	acceptance/bundle/templates/lakeflow-pipelines/python/output/my_lakeflow_pipelines/databricks.yml
#	acceptance/bundle/templates/lakeflow-pipelines/sql/output/my_lakeflow_pipelines/databricks.yml
#	acceptance/bundle/templates/pydabs/init-classic/output/my_pydabs/databricks.yml
#	acceptance/bundle/templates/telemetry/default-python/out.databricks.yml
#	acceptance/bundle/templates/telemetry/default-sql/out.databricks.yml
#	libs/template/templates/default-minimal/databricks_template_schema.json
#	libs/template/templates/default-scala/template/{{.project_name}}/databricks.yml.tmpl
#	libs/template/templates/default-sql/template/{{.project_name}}/databricks.yml.tmpl
#	libs/template/templates/default/template/{{.project_name}}/databricks.yml.tmpl
Point coding agents at Databricks AI Tools: read the databricks-core
skill, and install via `databricks aitools install` if it's missing.
CLAUDE.md is a one-line @AGENTS.md include. Decided at the DABs core
meeting.

Co-authored-by: Isaac
@github-actions

github-actions Bot commented Jul 21, 2026

Copy link
Copy Markdown
Contributor

Approval status: pending

/acceptance/bundle/ - needs approval

16 files changed
Suggested: @janniklasrose
Also eligible: @pietern, @shreyas-goenka, @andrewnester, @anton-107, @denik

/acceptance/pipelines/ - needs approval

6 files changed
Suggested: @kanterov
Also eligible: @jefferycheng1

/libs/template/ - needs approval

8 files changed
Suggested: @janniklasrose
Also eligible: @pietern, @shreyas-goenka, @andrewnester, @anton-107, @denik

General files (require maintainer)

Files: .nextchanges/bundles/agents-md-templates.md
Based on git history:

  • @janniklasrose -- recent work in .nextchanges/bundles/, libs/template/templates/dbt-sql/template/{{.project_name}}/, libs/template/templates/default-scala/template/{{.project_name}}/

Any maintainer (@andrewnester, @anton-107, @denik, @pietern, @shreyas-goenka, @simonfaltum, @renaudhartert-db, @janniklasrose) can approve all areas.
See OWNERS for ownership rules.

@@ -0,0 +1,33 @@
{{- /*

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This file is repeated a few times now, as a followup I want to look into a clean way to avoid the duplication. That will require a change in the templating code.

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The default-*/ templates already pick up everything from default/ so you only need to duplicate dbt-sql

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Unfortunately, default-sql and default-scala are also special right now.

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Followup PR: #6017

@eng-dev-ecosystem-bot

eng-dev-ecosystem-bot commented Jul 21, 2026

Copy link
Copy Markdown
Collaborator

Integration test report

Commit: b0d8254

Run: 29859238685

Env 🟨​KNOWN 💚​RECOVERED 🙈​SKIP ✅​pass 🙈​skip Time
💚​ aws linux 4 4 314 1045 4:48
💚​ aws windows 4 4 316 1043 7:10
💚​ azure linux 4 4 314 1044 4:50
💚​ azure windows 4 4 316 1042 4:15
🟨​ gcp linux 3 1 4 313 1046 8:38
🟨​ gcp windows 3 1 4 315 1044 10:32
8 interesting tests: 4 SKIP, 3 KNOWN, 1 RECOVERED
Test Name aws linux aws windows azure linux azure windows gcp linux gcp windows
💚​ TestAccept 💚​R 💚​R 💚​R 💚​R 💚​R 💚​R
🙈​ TestAccept/bundle/invariant/no_drift 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S
🙈​ TestAccept/bundle/resources/vector_search_endpoints/drift/recreated_same_name 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S
🙈​ TestAccept/bundle/resources/vector_search_indexes/recreate/embedding_dimension 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S
🙈​ TestAccept/ssh/connection 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S 🙈​S
🟨​ TestFetchRepositoryInfoAPI_FromRepo 💚​R 💚​R 💚​R 💚​R 🟨​K 🟨​K
🟨​ TestFetchRepositoryInfoAPI_FromRepo/root 💚​R 💚​R 💚​R 💚​R 🟨​K 🟨​K
🟨​ TestFetchRepositoryInfoAPI_FromRepo/subdir 💚​R 💚​R 💚​R 💚​R 🟨​K 🟨​K
Top 4 slowest tests (at least 2 minutes):
duration env testname
5:26 gcp windows TestAccept
4:48 aws windows TestAccept
3:07 azure windows TestAccept
2:08 aws windows TestAccept/bundle/deploy/mlops-stacks/DATABRICKS_BUNDLE_ENGINE=terraform

The lakeflow-pipelines template reuses default via template_dir, so
projects initialized by the pipelines/{init,e2e} acceptance tests now
emit AGENTS.md and CLAUDE.md; add them to those tests' goldens.

Co-authored-by: Isaac
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants