Post A Job
Jobs By Company
Keyword or Job ID
Sr. Data Engineer
Job Opportunity at
Cyntekk Solutions Inc.
Posted on Nov 17
Work on all phases of projects from design to implementation including specifications, development, testing, rollout, documentation and, if applicable, turnover to the Maintenance Engineering and Operations Team.
Work within state-of-the-art engineering practices (i.e. SCRUM, unit testing, design review, code reviews, continuous integration, etc.).
Partners with team lead to identify technical requirements and alternatives to accomplish project.
Providing accurate estimates for project development and implementation. Work with management to meet those estimates.
Participates in design, code, test, maintenance, enhance and decommission phases throughout software life cycle to contribute technical expertise and to identify issues.
Mitigates risk for the project, team and company.
Work with the Architecture team in defining software and infrastructure technical solutions.
Ensures knowledge transfer to team members within and outside of immediate group.
Iteratively improves projects with agile delivery practices.
5-8 years of full software development lifecycle experience
5 years of experience developing big-data applications
3+ years of experience with Apache Spark including Spark Streaming
3+ years of experience with the Hadoop batch processing framework and map reduce design patterns
3+ years of experience with Java/Scala/Python in support of data applications.
Strong Java 1.8+ Experience
Strong Scala 2.11 Experience
Strong Linux Experience
Significant exposure to and demonstrated proficiency in all aspects of programming and analysis including design patterns, hardware and software requirements, systems requirements and deployment protocols
Agile experience using Scrum
Experience with open source technologies
Experience with a widely used RDBMS’ and SQL
Experience with at least one columnar NoSQL solution
Experience developing, maintaining, and innovating large scale, consumer facing web applications
Experience working in a large big data enterprise organization
Experience with Apache Airflow
Experience with Amazon AWS
Experience with AWS EMR
Experience with docker and Kubernetes
Experience with Restful APIs
Experience with Apache Kafka
Experience creating robust and reliable data pipelines
Familiar with the development challenges inherent with highly scalable and available data applications.
Experience with Apache HBase
Experience with Apache Hive and/or Apache Crunch
Experience with Apache Avro.
Experience with the uses of various NoSQL solutions including HBase, MongoDB, Neo4j
Operational experience with large software systems
Schema and/or Cube design experience
Exposure to statistics, machine learning and natural language processing applications
Exposure to security, PII and PCI compliance issues
BS in computer science, engineering, mathematics or physical sciences
BS or MS in computer science, engineering, mathematics or physical sciences
Terms of Usage
ProgrammingCareers.com is owned, operated, and copyrighted by Career Marketplace (© 2002-2019, All Rights Reserved)