looking for a Sr. Data Engineer to be part of the Data Services Team. The Data Services team works very closely with all aspects of data, both internal and external. We are looking for a Data Engineer with the Software Engineering skill to build data pipelines for efficient and reliable data movement across systems, and also to build the next generation of data tools to enable us to take full advantage of this data. In this role, your work will broadly influence the company's data consumers, executives and analysts.
Work and lead the team responsible design and develop Real-time dataflows and other data pipeline solutions
Lead analysis, architecture, design, and development of data warehouse and business intelligence solutions and using next generation data platforms.
Mentor other team members
Experience programming enterprise solutions in Java/Scala
Experience in Apache Kafka, Apache Spark, Apache HBase or any other big data technologies
Experience building and shipping highly scalable clickstream data pipelines and analytics systems on distributed data systems (Hadoop/AWS/Azure/GCP)
Experience in streaming technologies like AWS Kinesis or Kafka.
Experience building batch, real-time and streaming analytics pipelines with data from event data streams, NoSQL and APIs.
Experience with batch & stream processing technologies such Spark, KStreams, Samza etc.
Worked on two or more of the following databases: Oracle, MySQL, DB2 LUW, Cassandra or MongoDB
Experience with enterprise search technology (ElasticSearch, Solr, Lucene, etc.) Have a BS/MS in Computer Science and Engineering or Equivalent degree
Plus to have:
Experience in Machine Learning Weka, MLlib, TensorFlow, etc
Experience in Business Intelligence tools and technologies Tableau, Superset, Metabase
Salary: INR 4,00,000 - 9,00,000 P.A.
Industry: IT-Software / Software Services
Functional Area: IT Software - Application Programming, Maintenance
Role Category: Programming & Design
Role: Database Architect/Designer
Employment Type: Permanent Job, Full Time