BAT is evolving at pace - truly like no other organisation.
To achieve the ambition, we have set for ourselves, we are looking for colleagues who are ready to live our ethos every day. Come be a part of this journey!
BAT MEXICOIS LOOKING FOR ADATA ENGINEER (DATABRICKS / PYSPARK)
SENIORITY LEVEL: Junior Level
FUNCTION: Digital Business Solution
LOCATION: Monterrey
ROLE POSITIONING AND OBJECTIVES
This role belongs to the DBS function.
The role is accountable for support the US team in data integration, data architecture and process optimization tasks
Reports to: Data Engineer Lead
Reporting Level: Managerial
Geographic Scope: US
WHAT YOU WILL BE ACCOUNTABLE FOR
- Implement data ingestion pipelines from multiple data sources using Databricks and PySpark, ensuring the quality and consistency of data.
- Develop Big Data and non-Big Data cloud-based enterprise solutions in PySpark, SQL and related frameworks/libraries.
- Understand Data Architecture concepts.
- Processing performance analysis and optimization.
- Bringing standard methodologies in the following areas: Design & Analysis, Automation, Testing, Monitoring, Documentation.
- Coordinates issue resolution with multi-functional teams and vendors.
- Assists the project manager by assisting sharing work plans, effort estimates and delivery timelines for work you're doing.
CAN THIS BE YOUR FUTURE ROLE?
- Are you willing to develop your career in a fast-paced global company?
ESSENTIAL EXPERIENCE, SKILLS AND KNOWLEDGE
- Bachelor's Degree or equivalent experience in Computer Science/Engineering.
- +2 years working experience.
- Experience with partners and requirements gathering/implementation.
- Experience with Python and Pandas.
- Experience developing extract, transform, load (ETL) pipelines using PySpark and Cloud Storage (AWS S3 preferred).
- Experience with Databricks.
- Experience with Cloud technologies – Azure, AWS, GCP, Teradata, Snowflake (preferably AWS).
- Experience Control-Versioning coding such as Git.
- Sophisticated English – Verbal and written
BENEFICIAL
- Shown background with Databricks or equivalent experience in: Workflows.Widgets,MachineLearning (MLFlow), SQL Warehousing / Delta tables, Unity Catalog, Worker/Driver Logs analysis).
- Experience with Programming Object-Oriented and MLOPS (Azure DevOps); and software development applying best-practice methodologies and frameworks such as Agile, Scrum, etc
- Experience with AWS Redshift, Teradata, Snowflake and orchestration toolsets (e.g. Airflow, Tidal).
- Professionalize the full pipeline including distributed Machine Learning models and ETL workflows (e.g., training/test pipeline).
WE ARE BAT
At BAT we are committed to our Purpose of creating A Better Tomorrow. This is what drives our people and our passion for innovation. See what is possible for you at BAT.
- Global Top Employer with 53,000 BAT people across more than 180 markets
- Brands sold in over 200 markets, made in 44 factories in 42 countries
- Newly established Tech Hubs building world-class capabilities for innovation in 4 strategic locations
- Diversity leader in the Financial Times and International Women’s Day Best Practice winner
- Seal Award winner – one of 50 most sustainable companies
BELONGING, ACHIEVING, TOGETHER
Collaboration, diversity and teamwork underpin everything we do here at BAT. We know that collaborating with colleagues from different backgrounds is what makes us stronger and best prepared to meet our business goals. Come bring your difference!