ThoughtFocus - Data Engineer - Python/Java/Scala (2-5 Yrs) Gurgaon/Gurugram (Systems/Product Software)

Qualifications : - Undergraduate or graduate degree in a technical or scientific field, such as Computer Science, Engineering, Mathematics, or similar - 2-5 years professional experience as a data engineer, software engineer, data analyst, data scientist, or related role - Analytically-minded and detail-oriented: you actually like staring at data, looking for patterns and outliers, establishing data models, and rigorously answering questions - Expertise in data engineering languages such as Python, Java, Scala, SQL.
-Data modeling and data governance experience; youve designed and implemented a data mart, a data warehouse, or the back-end database of an application - Experience building ETL and data pipelines, especially via code-oriented systems like Spark, Airflow, Luigi, or similar, and with varied data formats - Cloud-oriented but comfortable with on-premises infrastructure - Experience operating in a secure networking environment (e.g. behind a corporate proxy) is a plus - Creative problem-solving skills, especially in situations where nobody has tried this before - Excellent technical documentation and writing skills: you know Markdown syntax cold, and have published API documentation or similar - Youre not satisfied with close enough solutions, and you design long-term solutions that are robust over time - You have a bias towards automation: one-time scripts eat away at your soul a little bit each time you write one - Proficiency in statistics and machine learning is a nice-to-have, and interest in learning these is even better - Familiarity with visualizing data with Tableau and similar tools - Great customer service and technical troubleshooting skills Responsibilities : - Full-stack design, development, and operation of core data stack including data lake, data warehouse, and data pipelines - Build data flows for data acquisition, aggregation, and modeling, using both batch and streaming paradigms - Consolidate/join datasets to create easily consumable, consistent, holistic information - Design and implement machine learning models and prediction APIs, and ensure their operational performance over time - Empower data scientists and data analysts to be as self-sufficient as possible by building core systems and developing reusable library code - Support and optimize desktop and cloud environments for data scientists and data analysts - Ensure efficiency, quality, resiliency of data science core systems - Work with senior technical staff throughout Blackstones portfolio companies to develop data flows

Required Skills : English