* Develop and maintain scalable, reliable, and high-performance data pipelines to process, transform and load data into our data warehouse.* Collaborate with software engineers, data scientists, business and product development teams* Optimize data pipelines for performance and cost-efficiency, leveraging best practices and appropriate technologies.* Implement data quality and validation checks to ensure accuracy and consistency of data.* Document data pipelines, processes and workflows for internal reference and knowledge sharing.* A degree in computer science, information systems or related field.* At least 3 years’ experience as Data Engineer with track record of building and maintaining data pipelines.* Proficiency in Python, including performance optimization techniques* Fluency in Linux shell scripting* Knowledge of Business intelligence and Data Visualization tools such as Tableau/PowerBI/Qlik* Expertise in processing and storage of large-scale time-series data and knowledge of related technologies. Knowledge of KDB is a strong plus.* Strong SQL and relational database experience* Familiarity with cloud compute platforms is a plus.* Understanding of software development life cycle* Interest in automated testing and continuous integration* A drive to learn and master new technologies and techniques* Comfortable in a fast-paced, dynamic environment* Excellent communication and collaboration skills* Financial industry experience is preferred but not required
#J-18808-Ljbffr