Overview
Databricks Architects and Engineers Jobs in Eastern Region at NTT DATA North America
Title: Databricks Architects and Engineers
Company: NTT DATA North America
Location: Eastern Region
Experienced Databricks Architects and Engineers.
NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.
Key Responsibilities (Architect):
- Develop and articulate long-term strategic goals for data architecture vision and establish data standards for enterprise systems.
- Utilize various cloud technologies, including Azure, AWS, GCP, and data platforms like Databricks and Snowflake.
- Conceptualize and create an end-to-end vision outlining the seamless flow of data through successive stages.
- Institute processes for governing the identification, collection, and utilization of corporate metadata, ensuring accuracy and validity.
- Implement methods and procedures for tracking data quality, completeness, redundancy, compliance, and continuous improvement.
- Evaluate and determine governance, stewardship, and frameworks for effective data management across the enterprise.
- Develop comprehensive strategies and plans for data capacity planning, data security, life cycle data management, scalability, backup, disaster recovery, business continuity, and archiving.
- Identify potential areas for policy and procedure enhancements, initiating changes where required for optimal data management.
- Formulate and maintain data models and establish policies and procedures for functional design.
- Offer technical recommendations to senior managers and technical staff in the development and implementation of databases and documentation.
- Stay informed about upgrades and emerging database technologies through continuous research.
- Collaborate with project managers and business leaders on all projects involving enterprise data.
- Document the data architecture and environment to ensure a current and accurate understanding of the overall data landscape.
- Design and implement data solutions tailored to meet customer needs and specific use cases.
- Provide thought leadership by recommending the most suitable technologies and solutions for various use cases, spanning from the application layer to infrastructure.
Preferred Skills:
- Possess certifications in AWS, Azure, and GCP to complement extensive hands-on experience.
- Demonstrated expertise with certifications in Databricks.
—–
Key Responsibilities (Data Engineers):
- Develop and maintain data pipelines using Databricks and Python.
- Build and orchestrate ETL/ELT workflows using Azure Data Factory (ADF).
- Work with Azure cloud data services to support data ingestion, transformation, and processing.
- Optimize and monitor Databricks jobs and data pipelines for performance and reliability.
- Collaborate with architects, analysts, and business stakeholders to implement scalable data solutions.
- Ensure best practices in data engineering, code quality, and documentation.
- Participate in code reviews, troubleshooting, and production support activities.
Minimum Skills Required:
- Strong hands-on experience in Databricks
- Python scripting for data engineering workloads
- Good experience with Azure Data Factory
- Solid understanding of Azure Cloud fundamentals
- Experience in data pipeline development and ETL frameworks
- Strong communication and stakeholder interaction skills
- Experience working in Agile / Scrum teams