Squadcast - Data Engineer - ETL/Machine Learning (3-6 Yrs) Bangalore (Systems/Product Software)

DESCRIPTION : - Machine learning pipelines and ETL processes that operate at arbitrary scale - Reliable, stateless services that can be dynamically scaled and continuously deployed - Analytical jobs and services to measure model performance offline and in production - Tooling to help us productionize machine learning models faster REQUIREMENTS : - Expertise in atleast one of each category below : - 3 years of experience building fault tolerant, self-healing, auto-scaling, and cost-optimized services on modern cloud infrastructure - Object oriented programming in languages like Python or Java - Experience with functional programming in Scala/Spark is a plus - Data modeling and schema evolution tools - Parallelism, concurrency, and distributed system concepts (knowledge of CQRS, Event Sourcing, CAP Theorem) - Understand what turning the database inside out means and its relevance to distributed commit logs and stream processing frameworks.
-Expert knowledge of SQL and data querying tools libraries - Micro service architecture design. Prior experience with A/B testing machine learning services before deployment is a plus - API design and evolution - Machine learning fundamentals is a plus - Big data frameworks like Spark and Hadoop - Schema evolution tools such as Thrift, Avro or Protocol Buffers - Modern distributed databases like MongoDB, Cassandra, and Riak - Stream processing frameworks such as Kafka, Flink, Storm, and Samza - Hands-on skills in Elasticsearch querying, indexing, sharding, replication, failover, fault tolerance - Infrastructural tools like Docker, Zookeeper, Mesos, and Marathon and the ability to deploy machine learning services reliably with these tools - AWS systems like EC2, SQS, EMR and Redshift

Required Skills : English