Software Engineer - Data Engineering
Zeotap
Software Engineering, Data Science
Bengaluru, Karnataka, India
Posted on Aug 1, 2024
About the company
Founded in 2014 in Europe, Zeotap's mission is to make customer data easy, secure and impactful.
Zeotap empowers the world's most innovative brands to deliver more engaging customer experiences from smart and efficient use of customer data via an AI-native platform that respects consumer privacy.
Enterprises benefit from faster and improved business outcomes across marketing, sales and service, while ensuring compliance.
Zeotap is expanding its SAAS product suites branded as Customer Intelligence Platform consisting of an integrated product suite for Customer data collection, ID resolution, Predictive Analytics, Audience management and Activation.
Our ideal candidate will be passionate about helping our enterprise customers and business teams across the globe, enjoy resolving problems, identifying root causes of issues, and thrive in a team environment. The incoming person would be responsible for end-to-end ticket resolution and communication with the customers and other stakeholders within the SLA, escalations to the internal teams based on SOPs, creation of internal knowledge based articles and perform engineering support activities as and when required.
Responsibilities:
- You will design and implement robust, scalable, and high-performance data pipelines using Spark, Scala, and Airflow with familiarity on Google Cloud.
- You develop, construct, test, and maintain architectures such as databases and large-scale processing systems.
- You will assemble large, complex data sets that meet functional and non-functional business requirements.
- You build the infrastructure required for optimal extraction, transformation, and loading (ETL) of data from various data sources.
- You will collaborate with data scientists and other stakeholders to improve data models that drive business processes.
- You implement data flow and tracking using Apache Airflow.
- You ensure data quality and integrity across various data processing stages.
- You monitor and optimize the performance of the data processing pipeline.
- You will tune and optimize Spark jobs for performance and efficiency, ensuring they run effectively on large-scale data sets.
- You troubleshoot and resolve issues related to data pipelines and infrastructure.
- You stay up-to-date with the latest technologies and best practices in Big Data and data engineering.
- You adhere to Zeotap’s company, privacy and information security policies and procedures
- You complete all the awareness trainings assigned on time
Requirements:
- 2+ years of experience in building and deploying high scale solutions
- Must have very good problem-solving skills and clear fundamentals of DS and algorithms
- Expert coding skills in Java or Scala
- Expert coding skills in Go or Python is a huge plus
- Apache Spark or other Bigdata stack experience is a mandatory
- High level and low-level design skills.
- Deep understanding of any OLTP, OLAP, NoSQL or Graph databases is a huge plus.
- Deep knowledge of distributed systems and design is a huge plus
- Hands-on with Streaming technologies like Kafka, Flink, Samza etc is a huge plus
- Good knowledge of scalable technologies involving Bigdata technologies
- Bachelor or Master’s degree in information systems, computer science or other related fields is preferred
What we offer:
- Competitive compensation and attractive perks
- Health Insurance coverage
- Flexible working support, guidance and training provided by a highly experienced team
- Fast paced work environment
- Work with very driven entrepreneurs and a network of global senior investors across telco, data, advertising, and technology
Zeotap welcomes all – we are equal employment opportunity & affirmative action employer. Qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender perception or identity, national origin, age, marital status, protected veteran status, or disability status.
Interested in joining us?
We look forward to hearing from you!