Databricks Engineer - Data Engineer III

We are seeking a Senior Data and AI engineer with expertise in cloud data engineering. You will work with large datasets, leverage AI technologies, and utilize Databricks for data processing and analytics to support business objectives.

Key Responsibilities

You will play a key role in transforming enterprise business data into insights. You will collaborate with other data and AI engineers and business stakeholders to create scalable data and AI solutions that align with business needs.

• Collaborate with business stakeholders to understand their data needs and provide tailored solutions that meet their business objectives

• Analyzing business requirements and translating them into technical specifications

• Design, develop and implement data engineering solutions using Azure Databricks Lakehouse platform.

• Build Data and AI solutions that leverage Databricks Genie, AgentBricks, Mosaic AI, MLFlow, Unity Catalog and other Databricks components

• Conduct detailed data analysis to identify existing data tables and if required designing new tables, views and other objects using Databricks platform.

• Apply AI and machine learning techniques to structured and unstructured data processing and analysis.

• Ensure data quality, integrity, and security throughout the data lifecycle.

• Collaborate with data scientists and analysts to meet data requirements.

• Communicate effectively with stakeholders, including technical and non-technical audiences, to convey complex data concepts

• Stay updated with the latest trends and technologies in data engineering, AI, LLMs and Agentic AI

Required Skills & Qualifications

* Bachelor's degree in computer science, engineering, or related field

• 5-7 years proven experience as a Data Engineer with cloud-based data platforms like Databricks, Snowflake, BigQuery

• Expertise with Databricks SQL, Compute Warehouses, AI/BI Genie, AgentBricks, Unity Catalog and Vector indexes

• Experience with data modeling, Medallion architecture, ETL processes and data warehousing concepts.

• Strong programming skills in languages such as Python, SQL or Scala

• Experience with DevOps and DataOps process to deploy data objects and pipelines across environments using scripts and agile process

• Experience with AI/ML concepts and their application in data engineering.

• Excellent problem-solving skills and ability to work independently and as part of a team

Familiarity with cloud platforms (e.g., AWS, Azure, GCP).

EXPERIENCE AND EDUCATIONAL REQUIREMENTS:

* Bachelor's degree in Programming/Systems or Computer Science or other related field. Or equivalent work experience.

MINIMUM SKILLS, KNOWLEDGE AND ABILITY REQUIREMENTS:

* 5-10 years of experience in technologies relevant to data/information management, such as SQL, Azure Databricks inculding Databricks Genie, AgentBricks, Mosaic AI, MLFlow, Unity Catalog and other Databricks components

* Has a broad level of understanding surrounding AI use cases supporting business needs.

* Experience in leading small project teams and streams.

* Demonstrated ability to analyze and interpret complex problems or processes that span multiple business areas, identify and understand requirements, and develop alternate solutions.

* Experience designing, developing and testing applications using proven or emerging technologies in a variety of technologies and environments.

We provide compensation, benefits, and resources that enable a highly inclusive culture and support our team members' ability to live with purpose every day. In addition to traditional offerings like medical, dental, and vision care, we also provide a comprehensive suite of benefits that focus on the physical, emotional, financial, and social aspects of wellness. This encompasses support for working families, which may include backup dependent care, adoption assistance, infertility coverage, family building support, behavioral health solutions, paid parental leave, and paid caregiver leave. To encourage your personal growth, we also offer a variety of training programs, professional development resources, and opportunities to participate in mentorship programs, employee resource groups, volunteer activities, and much more. For details, visit https://www.virtualfairhub.com/cencora

*This Salary Range reflects a National Average for this job. The actual range may vary based on your locale. Ranges in Colorado/California/Washington/New York/Hawaii/Vermont/Minnesota/Massachusetts/Illinois State-specific locations may be up to 10% lower than the minimum salary range, and 12% higher than the maximum salary range.

Cencora is committed to providing equal employment opportunity without regard to race, color, religion, sex, sexual orientation, gender identity, genetic information, national origin, age, disability, veteran status or membership in any other class protected by federal, state or local law.

The company's continued success depends on the full and effective utilization of qualified individuals. Therefore, harassment is prohibited and all matters related to recruiting, training, compensation, benefits, promotions and transfers comply with equal opportunity principles and are non-discriminatory.

Cencora is committed to providing reasonable accommodations to individuals with disabilities during the employment process which are consistent with legal requirements. If you wish to request an accommodation while seeking employment, please call 888.692.2272 or email hrsc@cencora.com. We will make accommodation determinations on a request-by-request basis. Messages and emails regarding anything other than accommodations requests will not be returned

.