Spark Developer Job at Raya Workforce, Maryland

S04zTWxqY09WV3d2OUhsZmxRSDBya3lwM0E9PQ==
  • Raya Workforce
  • Maryland

Job Description

We are hiring a Spark Developer to design, develop, and maintain large-scale data processing systems using Apache Spark . This remote role provides the opportunity to work on cutting-edge big data technologies, optimizing and processing massive datasets to support analytics and business decisions.

Key Responsibilities
  • Develop, test, and maintain scalable data pipelines using Apache Spark for batch and real-time data processing.
  • Work with large datasets, ensuring they are efficiently processed and made available for analytics and machine learning models.
  • Integrate Spark with other big data technologies like Hadoop , Kafka , and Hive to build robust data processing solutions.
  • Collaborate with data engineers, data scientists, and other stakeholders to understand data requirements and ensure the successful implementation of data pipelines.
  • Write efficient, high-performance code to process large amounts of data in real-time or batch mode.
  • Ensure the performance, scalability, and security of data pipelines.
  • Perform data transformations, aggregations, and analysis using Spark SQL and DataFrames .
  • Optimize and troubleshoot Spark applications for performance and resource efficiency.
  • Document and maintain technical specifications and workflows.
Qualifications & Skills
  • Strong proficiency in Apache Spark (with PySpark , Spark SQL , and Spark Streaming ).
  • Experience with Hadoop ecosystem components such as HDFS , Hive , and YARN .
  • Expertise in SQL and NoSQL databases like MongoDB , Cassandra , or HBase .
  • Proficiency in programming languages like Java , Scala , or Python .
  • Hands-on experience with Kafka , AWS , Azure , or Google Cloud (for cloud-based data processing).
  • Strong knowledge of data warehousing concepts, ETL processes, and data modeling.
  • Experience in performance tuning of Spark applications.
  • Ability to work with distributed systems and big data technologies.
  • Excellent problem-solving and debugging skills.
  • Bachelor's degree in Computer Science, Engineering, or a related field.
  • 2+ years of experience in Spark-based data development and processing.

Job Tags

Full time, Remote job,

Similar Jobs

Prince Industries LLC

Overhead Crane Operator - 2nd Shift Job at Prince Industries LLC

 ...JOB SUMMARY The Crane Operator transports materials using a 5-ton overhead crane and/or forklift, loading and unloading materials and assisting the laser department. ESSENTIAL DUTIES AND RESPONSIBILITIES Operates a 5-ton crane to move parts around the... 

JJM Marketing LLC

Solar Consultant Job at JJM Marketing LLC

 ...Become a Solar Consultant at AMP Smart Solar! Are you passionate about renewable energy and eager to make a difference? AMP Smart Solar is searching for motivated Solar Consultants to join our team. In this role, you will play a crucial part in helping homeowners discover... 

Shine To Prosper

Executive Coach - Remote Job at Shine To Prosper

 ...Tailor your journey with the freedom to choose between full or part-time commitments your journey, your pace. *This is not a coaching client referral model so if that is what you're seeking, this won't be a good fit *Your performance will be generously rewarded... 

Exile TR

Class A Dry Van Truck Driver Job at Exile TR

 ...Regional dry van carrier is looking for drivers interested in running Texas, Oklahoma, the Southeast, the Midwest, and the Northeast. All freight is dry van, 100% no touch, and 65% drop n hook. A drivers weekly pay averages between $1300-$1800 depending on how hard you... 

Element Solutions Inc

Process Engineer Job at Element Solutions Inc

 ...Wafer Level Solutions : Revolutionizing wafer fabrication processes for enhanced efficiency and performance. Semiconductor Assembly...  .... Who are we looking for? We are looking for a Process Engineer whos ready to dive into optimizing our operations! Under the...