Skip to content

Changes done for adding formats to the Azure Blob Storage plugin#163

Open
vikasrathee-cs wants to merge 2 commits into
data-integrations:developfrom
cloudsufi:guava-cdap-ui-fix
Open

Changes done for adding formats to the Azure Blob Storage plugin#163
vikasrathee-cs wants to merge 2 commits into
data-integrations:developfrom
cloudsufi:guava-cdap-ui-fix

Conversation

@vikasrathee-cs

Copy link
Copy Markdown

Changes done for adding formats to the Azure Blob Storage plugin

@gemini-code-assist gemini-code-assist Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Code Review

This pull request refactors the Azure Blob Store batch source to support Azure Data Lake Storage Gen2 (ABFS) alongside WASB, introducing new authentication methods such as Service Principal and Managed Identity. The implementation is updated to extend AbstractFileSource instead of AbstractFileBatchSource, with corresponding updates to documentation, dependencies, and UI widgets. The review feedback highlights critical safety improvements, specifically pointing out potential NullPointerException risks when validating or parsing null path and account values, as well as identifying obsolete UI widgets that should be removed.

Comment thread azure-blob-store/widgets/AzureBlobStore-batchsource.json Outdated
Comment thread pom.xml
Comment thread azure-blob-store/src/main/java/io/cdap/plugin/source/AzureBatchSource.java Outdated
Comment thread azure-blob-store/src/main/java/io/cdap/plugin/source/AzureBatchSource.java Outdated
}

String authMethod = config.authenticationMethod;
String account = config.account;

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Can account be null / macro ?

Comment thread pom.xml Outdated
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants