Big data lead big data architect big data engineer

ROLE:- Bigdata Lead (1st)Location:- MD, Bethesda( remote with travelling can be given)The Big Data lead will be responsible for building, maintaining data pipelines and data products to ingest, process large volume of structured / unstructured data from various sources. The Big Data lead will work on analyzing the data needs, migrating the data into an Enterprise data lake, build data products and reports. The role requires experience with building real time and batch based ETL pipelines with strong understanding of big data technologies and distributed processing frameworks with.Experience (Total, Relevant)8 to 10 yearsTech Skills:-Hive, Snowflake, Nifi, Jenkins, Airflow, AWS, Unix , Kafka , EMR, Spark Scala , Bigdata with SnowflakeROLE:- Bigdata Architect (2nd)Location:- MD, Bethesda( onsite)Architect with Proven experience in Big Data, Cloud and Relational data store migrationExperience (Total, Relevant)12 + yearsTech Skills:-Bigdata Architect, Hive, Snowflake, Nifi, Jenkins, Airflow, AWS, Unix , Kafka , EMR, Spark Scala , Bigdata with SnowflakeROLE:- Big Data Engineer(3rd)Location : New York Or RemoteExperience Level – 5 to 7 YearsJob Description:-Strong software development skills and ability to multitask in an Agile environment5+ years’ experience programming in one of the languages like Java( Is a must as our framework is in Java), Python.3+ years’ experience with Kafka connects or equivalent.Excellent communication skills and the ability to collaborate across teams, manage competing goals and changing priorities in a fast-paced environment3+ years’ experience working with Big Data technologies such as HDFS, Hadoop, Spark, Hive, HBase, Druid, etc.3+ years’ experience working with Apache Kafka or other message queuing systems Experience with Data pipelines at scale.Experience working with/in containerized environments using Docker, Kubernetes, Swarm, Rancher, Mesos - Experience writing parsers/schemas for semi-structured and unstructured content - Experience with Elasticsearch, Solr, Cassandra and other database technologies Powered by Webbtree