The roleAs a Data Engineering Manager, you will play a key role in designing, implementing, and managing robust data pipelines and infrastructure that power our data-driven initiatives.This role is responsible for:Leading and mentoring a team of data engineers, fostering a collaborative and high-performing culture.Designing, developing, and maintaining low-latency data pipelines using Apache Spark and Scala, while ensuring data accuracy, reliability, and efficiency.Implementing and optimizing Spark structured streaming to process real-time data and support timely business insights.Optimizing SQL queries and design data structures in data lakes and warehouses to improve overall performance and query efficiency.Fostering cost-consciousness and creative problem-solving in the team to optimize cloud-based solutions and reduce operational expenses.Utilizing your expertise in AWS cloud services and technologies to architect and build robust data solutions on the cloud platform.Leading the successful delivery of non-trivial data products and services, ensuring high-quality standards across all aspects of development and deployment.Collaborating with cross-functional teams, including Data Scientists, Product Managers, and Software Engineers, to understand data requirements and deliver data solutions aligned with business goals.Staying updated with the latest industry trends and best practices, sharing knowledge and encouraging the team to continuously improve their skills.Fostering a passion for data engineering and our company's mission, instilling a culture of quality, open communication, and continuous learning.You bringExpert Career (10+ Years)Bachelor's or Master's degree in Computer Science, Data Engineering, or a related field.Proven experience in designing and implementing low-latency data pipelines using Spark structured streaming.Solid understanding of optimizing SQL queries and experience with data lake and data warehouse design.Proficiency in AWS cloud services and technologies, with a track record of building scalable solutions on the cloud platform.Prior experience managing and leading a team of data engineers or related roles.Demonstrated ability to build and deliver non-trivial data products and services.A passion for technology and data, with a strong emphasis on quality and continuous improvement.Excellent communication and interpersonal skills, with the ability to collaborate effectively with cross-functional teams.A desire to keep growing your skills, and an ability to learn quickly. We hire for slope, not just y-intercept.Powered by JazzHR
