Software Engineer: Web Scraping and Data Integration

1 semana atrás

Rio de Janeiro, Rio de Janeiro, Brasil beBeeDataScientist Tempo inteiro R$140.000 - R$182.000

Job Title

Product Development Opportunity
  • As a skilled software engineer, you will play a key role in developing web scraping scripts and tools using Python.
  • The ideal candidate has proven work experience as a Python developer with expertise in web scraping.
  • Strong proficiency in Python programming language and related libraries such as BeautifulSoup, Scrapy, or Selenium is required.
  • Experience with message brokers like Redis, Kafka, or RabbitMQ for efficient data ingestion and distribution is essential.

Responsibilities:


Key Responsibilities
  1. Develop and maintain web scraping scripts and tools using Python.
  2. Gather requirements from stakeholders and design effective scraping strategies to extract data from websites.
  3. Implement and optimize scraping algorithms to handle complex data structures, dynamic content, and authentication mechanisms.
  4. Utilize AWS services such as EC2, S3, Lambda, and Glue for data processing, storage, and computation.
  5. Work with cross-functional teams to integrate scraped data into data pipelines and analytics systems.

Requirements:


Essential Skills and Qualifications
  • Proven work experience as a Python Developer with expertise in web scraping.
  • Strong proficiency in Python programming language and related libraries such as BeautifulSoup, Scrapy, or Selenium.
  • Knowledge of AWS services such as EC2, S3, Lambda, Glue, and familiarity with AWS SDKs.
  • Experience with message brokers like Redis, Kafka, or RabbitMQ for efficient data ingestion and distribution.

Why Work with Us?


Join a collaborative environment with flexible working conditions and opportunities to grow as an expert. You will have 12 days of paid vacation, 10 sick days and off days, friendly and open-minded team, and English classes.

  • Senior Python Developer

    2 semanas atrás

    Rio de Janeiro, Rio de Janeiro, Brasil beBeeMachineLearning Tempo inteiro R$60.000 - R$95.000

    **Python Data Scraper Role**Our organization is seeking a talented Python developer to join our data analytics/machine learning team.The successful candidate will be responsible for designing and implementing large-scale web scraping solutions using Python, working closely with the data team to ensure seamless integration of data into our analytics...

  • Software Engineer

    3 semanas atrás

    Rio de Janeiro, Rio de Janeiro, Brasil Braintrust Tempo inteiro

    Job Title Software Engineer - C# at Braintrust Job Description Pyyne is a modern technology consultancy engineering the next generation of digital products and services. At Pyyne, we believe in using technology to unlock business potential, create sustainable growth, and drive forward digital excellence. Our solutions range from advanced Software...

  • Python And Kubernetes Software Engineer

    1 semana atrás

    Rio de Janeiro, Rio de Janeiro, Brasil Canonical Tempo inteiro

    Python and Kubernetes Software Engineer - Data, Workflows, AI/ML & AnalyticsJoin or sign in to find your next jobJoin to apply for the Python and Kubernetes Software Engineer - Data, Workflows, AI/ML & Analytics role at CanonicalPython and Kubernetes Software Engineer - Data, Workflows, AI/ML & Analytics1 week ago Be among the first 25 applicantsJoin to...

  • Senior Data Engineer

    2 semanas atrás

    Rio de Janeiro, Rio de Janeiro, Brasil beBeeDataEngineering Tempo inteiro R$90.000 - R$110.000

    About the RoleWe are seeking a seasoned Senior Data Engineer to join our team. As a key member, you will collaborate closely with data analysts and scientists to deliver high-quality data insights that drive business growth.Key Responsibilities:Design and develop scalable data pipelines in production environments using cutting-edge technologies.Work with...

  • Frontend Engineer

    3 semanas atrás

    Rio de Janeiro, Rio de Janeiro, Brasil Stott and May Tempo inteiro

    Join to apply for the Frontend Engineer role at Stott and May Join to apply for the Frontend Engineer role at Stott and May Design and build high-quality frontend components, leveraging React and Next.js Collaborate with the CTO and backend engineers to define and implement frontend architecture Communicate effectively with the backend team to ensure...

  • Python and Kubernetes Software Engineer

    2 semanas atrás

    Rio de Janeiro, Rio de Janeiro, Brasil Canonical Tempo inteiro

    Python and Kubernetes Software Engineer - Data, Workflows, AI/ML & Analytics Join or sign in to find your next job Join to apply for the Python and Kubernetes Software Engineer - Data, Workflows, AI/ML & Analytics role at Canonical Python and Kubernetes Software Engineer - Data, Workflows, AI/ML & Analytics 1 week ago Be among the first 25 applicants Join...

  • Junior Software Engineer

    Há 3 horas

    Rio de Janeiro, Rio de Janeiro, Brasil Bloquo Tempo inteiro R$40.000 - R$60.000 por ano

    About the RoleWe are looking for a Junior Fullstack Software Engineer to join our team at Bloquo, an innovative company building global cross-border payment infrastructure and market-making solutions powered by blockchain technology.This is a unique opportunity for someone at the beginning of their career who wants to grow fast, learn from experienced...

  • Senior Software Engineer

    3 semanas atrás

    Rio de Janeiro, Rio de Janeiro, Brasil Fielo Tempo inteiro

    Senior Software Engineer – Pega Systems Project At Fielo, we build Loyalty & Incentives solutions that transform the way companies engage with customers, partners, and employees. We are starting a strategic development project with Pega Systems and are looking for a Senior Software Engineer to design and deliver scalable, secure, and impactful solutions....

  • Senior Software Engineer

    3 semanas atrás

    Rio de Janeiro, Rio de Janeiro, Brasil Fielo Tempo inteiro

    Senior Software Engineer – Pega Systems ProjectAt Fielo, we build Loyalty & Incentives solutions that transform the way companies engage with customers, partners, and employees. We are starting a strategic development project with Pega Systems and are looking for a Senior Software Engineer to design and deliver scalable, secure, and impactful...

  • Data Engineer

    3 semanas atrás

    Rio de Janeiro, Rio de Janeiro, Brasil FullStack Labs Tempo inteiro

    Data Engineer - Remote - Latin America | FullStack Labs Join to apply for the Data Engineer - Remote - Latin America role at FullStack Labs. About FullStack FullStack is the most transparent IT talent network, connecting highly skilled individuals with top global companies and Silicon Valley startups for remote, on-demand projects. We focus on building a...