Software Engineer Id45371

Software Engineer ID***** – AgileEngineAgileEngine is an Inc. **** company that creates award-winning software for Fortune 500 brands and trailblazing startups across 17+ industries.We rank among the leaders in application development and AI/ML, and our people-first culture has earned us multiple Best Place to Work awards.Why Join UsIf you're looking for a place to grow, make an impact, and work with people who care, we'd love to meet you.About the RoleJoin our ambitious team as a Senior Software Engineer specializing in Data Engineering to develop cutting-edge trade surveillance technology, protecting investors and ensuring market integrity.You will have a profound impact by designing and scaling robust, highly available data pipelines and microservices, tackling complex data challenges using modern tools.This unique opportunity offers significant influence and professional growth in a dynamic, collaborative environment that values accountability and a self-starter attitude.What You Will DoDesign and develop microservices for the data team – Java services running on Kubernetes.Scale our data pipeline to support processing billions of events in both low-latency real-time and T+1 batch using advanced technologies like ClickHouse, Spark, and Kafka.Tackle data duplication, velocity, schema adherence (and schema versioning), high availability, data governance, and more.Develop and maintain our data pipeline written mostly in Java and running on Kubernetes in a micro-service architecture.Plan and communicate integrations with other teams that consume the data and use it for insights creation.Continuously improve how data is stored and served, optimizing queries and data formats to ensure the data is ready for consumption by a variety of clients.Optimize queries in our data warehouses, ensuring data completeness and reliability at scale.MUST HAVEBSc.in Computer Sciences from a top university, or equivalent.Strong background as a software engineer with at least 3+ years experience with Java.Experience in data engineering and data pipeline development.Proven experience with relational and non-relational DBs; expert in SQL and query optimizations – preferably in ClickHouse.Experience with monitoring systems (Prometheus, Grafana, Zabbix, Datadog).Experience in object-oriented development; strong software engineering foundations.Curiosity, ability to work independently, and proactively identify solutions.Excellent verbal and written communication skills in a remote environment.Upper-intermediate English level.NICE TO HAVEExperience working in low-latency, real-time systems processing billions of events per day.Experience with cloud data-engineering technologies such as Apache Airflow, Kubernetes, ClickHouse, Snowflake, Redis, Spark, caching technologies, and/or Kafka.Perks and BenefitsProfessional growth: Accelerate your professional journey with mentorship, TechTalks, and personalized growth roadmaps.Competitive compensation: We match your ever-growing skills, talent, and contributions with competitive USD-based compensation and budgets for education, fitness, and team activities.A selection of exciting projects: Join projects with modern solutions development and top-tier clients that include Fortune 500 enterprises and leading product brands.Flextime: Tailor your schedule for an optimal work-life balance by having the option of working from home and going to the office – whatever makes you the happiest and most productive.Seniority levelMid-Senior levelEmployment typeFull-timeJob functionIT Services and IT Consulting#J-*****-Ljbffr