1001 Freelance Projects
Latest Projects from Freelance Marketplaces
Today is: 05-Mar-2026 16:34 GMT
View Project
View this project in detail (Note: you will be redirected to external marketplace)
Project title: web scraping solution
Posted by: External project from PeoplePerHour
Started: 10-Dec-2024 04:53 GMT
Description: Requerimiento: Solución de Web Scraping para Portales de Medios de Información
Objetivo del Proyecto
Diseñar e implementar una solución automatizada de web scraping para recopilar información de portales de medios de información. Los datos recolectados deberán ser almacenados en una base de datos mediante la ejecución de un procedimiento almacenado (stored procedure) en SQL.
________________________________________
Alcance
1. Realizar scraping en sitios web de medios de información predefinidos, incluyendo, pero no limitado a:
o Noticias nacionales
o Noticias internacionales
o Deportes
o Entretenimiento
o Economía
2. Recolectar información clave, como:
o Título de la noticia
o Fecha de publicación
o Autor (si está disponible)
o Resumen o encabezado
o Contenido completo del artículo
o Categoría o sección del portal
o URL de la noticia
o Fuente del medio
3. Guardar los datos en una base de datos SQL mediante un stored procedure que permita:
o Validar la integridad de los datos antes de insertarlos.
o Evitar duplicidad de registros.
________________________________________
Requerimientos Funcionales
1. Extracción de Datos:
o Implementar un módulo para realizar scraping de páginas HTML dinámicas y estáticas.
o Manejar sitios con diferentes estructuras HTML, incluyendo aquellos que requieran interacción con JavaScript.
2. Gestión de Acceso:
o Incorporar control de acceso para sitios protegidos (si aplica), como inicios de sesión.
o Considerar técnicas anti-bloqueo (User-Agent Rotation, IP Proxy).
3. Almacenamiento de Datos:
o Diseñar un esquema en SQL que soporte la información recolectada.
o Implementar un procedimiento almacenado para insertar los datos en la base de datos, manejando validaciones como:
 Verificación de duplicados por URL.
 Registro de errores o inconsistencias en una tabla de logs.
4. Escalabilidad:
o Posibilidad de agregar nuevos portales sin modificar significativamente el código base.
5. Frecuencia:
o Programar ejecuciones automáticas en intervalos configurables (diario, semanal, etc.).
________________________________________
Requerimientos Técnicos
1. Lenguaje de Programación:
o Python (preferiblemente) o Node.js, utilizando frameworks como Beautiful Soup, Scrapy o Puppeteer.
2. Base de Datos:
o SQL Server o un motor compatible que permita la ejecución de procedimientos almacenados.
3. Integración con la Base de Datos:
o El programa de scraping debe ejecutar el stored procedure tras procesar cada lote de datos.
4. Manejo de Excepciones:
o Registro detallado de errores durante el scraping, almacenamiento o ejecución de stored procedures.
5. Compatibilidad:
o Diseñar la solución para que sea compatible con sistemas operativos Windows y Linux.
________________________________________
Criterios de Aceptación
1. La solución debe ser capaz de recolectar y almacenar información de al menos 5 portales de noticias iniciales.
2. La inserción en la base de datos debe completarse sin errores y siguiendo las validaciones establecidas.
3. El sistema debe ser modular para facilitar la adición de nuevos portales.
4. Los datos deben ser accesibles para consultas SQL tras su almacenamiento.
________________________________________
Project ID: 3411981
Project category:
Project budget:
View this project in detail (Note: you will be redirected to external marketplace)
Last Projects / Browse Projects
  Project Started
US Bitcoin Investor Phone Leads
Category: Data Collection, Data Entry, Data Management, Data Processing, Excel, Lead Generation, Leads, Telemarketing
Budget: £250 - £750 GBP
05-Mar-2026
11:04 GMT
Copy-Paste From Documents Task
Category: Copy Typing, Copywriting, Data Entry, Data Management, Data Processing, Editing, Project Management, Proofreading, Word
Budget: ₹400 - ₹750 INR
05-Mar-2026
11:03 GMT
AI Image & Video Detector Website – Detect AI or Natural Content
Category: AI Content Creation, API Development, API Integration, CSS, HTML, JavaScript, PHP, Web Development, Web Design, WordPress
Budget: ₹12500 - ₹37500 INR
05-Mar-2026
11:01 GMT
Branding and Menus Graphic Designer
Category: Adobe Illustrator, Branding, Covers & Packaging, Creative Design, Graphic Design, Logo Design, Menu Design, Packaging Design, Photoshop, Print Design
Budget: $30 - $250 USD
05-Mar-2026
11:00 GMT
Recruiting Firm Client Deck
Category: Branding, Content Writing, Corporate Identity, Graphic Design, Logo Design, Powerpoint, Typography, Visual Design
Budget: ₹600 - ₹5000 INR
05-Mar-2026
10:57 GMT
Education Project Development Support
Category: Education Consulting, Educational Research, ELearning, Instructional Design, Logo Design, Research Writing
Budget: ₹750 - ₹1250 INR
05-Mar-2026
10:56 GMT
Eco-Friendly Product Packaging Design
Category: Graphic Design, Packaging Design, Print Design
Budget: ₹1500 - ₹12500 INR
05-Mar-2026
10:55 GMT
Trade Booth Panel Layouts
Category: Adobe Illustrator, Adobe InDesign, Photoshop, Brochure Design, Graphic Design, Logo Design, Print Design
Budget: $30 - $250 AUD
05-Mar-2026
10:54 GMT
Ready-Made Triple Chance Game with Print System
Category: C, Programming, C#, C++, Game Design, Game Development, Game Testing, Software Development, Unity, Unity 3D, Windows Desktop
Budget: ₹12500 - ₹37500 INR
05-Mar-2026
10:54 GMT
Motivational YouTube Video Editing
Category: Adobe Premiere Pro, After Effects, DaVinci Resolve, Final Cut Pro, Motion Graphics, Video Editing, Video Production, Video Services
Budget: ₹750 - ₹1250 INR
05-Mar-2026
10:52 GMT
Immediate Client Portal Dashboard Setup
Category: CSS, HTML, Virtual Assistant
Budget: $2 - $8 USD
05-Mar-2026
10:51 GMT
Narrative Analysis of Interview Data
Category: Coding, Data Analysis, Editing, Ghostwriting, Qualitative Research, R Programming Language, Report Writing, Research Writing
Budget: £250 - £750 GBP
05-Mar-2026
10:51 GMT
Marketplace Growth Strategist (Footwear/Fashion)
Category: Advertising, Amazon, Analytics, Brand Management, Data Analysis, Growth Hacking, Internet Marketing, Keyword Research, PPC Marketing, SEO
Budget: ₹12500 - ₹37500 INR
05-Mar-2026
10:50 GMT
4-Week AdWords & Instagram Lead Campaign
Category: A / B Testing, Advertising, Digital Marketing, Facebook Marketing, Google Ads, Google Adwords, Instagram Marketing, Internet Marketing, Lead Generation, Search Engine Marketing (SEM)
Budget: $250 - $750 USD
05-Mar-2026
10:45 GMT
Join our Ranqing AI partnership program and become a partner of Ranqing AI, a free AI tool to help freelancers manages their SEO and GEO clients
Category: AI Consulting, Analytics, Data Analytics, Digital Marketing, Generative Engine Optimization (GEO), Geofencing, Google Ads, Search Engine Marketing (SEM), SEO, SEO Auditing
Budget: $250 - $750 USD
05-Mar-2026
10:45 GMT
Browse All Projects
Projects by Skills ...
Projects for 'android'
Projects for 'ajax'
Projects for 'asp'
Projects for 'aspnet'
Projects for 'cms'
Projects for 'cpp'
Projects for 'csharp'
Projects for 'css'
Projects for 'delphi'
Projects for 'design'
Projects for 'drupal'
Projects for 'excel'
Projects for 'facebook'
Projects for 'flash'
Projects for 'html'
Projects for 'java'
Projects for 'javascript'
Projects for 'joomla'
Projects for 'iphone'
Projects for 'mysql'
Projects for 'photoshop'
Projects for 'php'
Projects for 'python'
Projects for 'ruby'
Projects for 'seo'
Projects for 'sql'
Projects for 'sysadm'
Projects for 'translate'
Projects for 'typing'
Projects for 'twitter'
Projects for 'vbnet'
Projects for 'xml'
Projects for 'wordpress'
Projects for 'writing'
Read RSS feeds ... New!
RSS feed for 'android'
RSS feed for 'ajax'
RSS feed for 'asp'
RSS feed for 'aspnet'
RSS feed for 'cms'
RSS feed for 'cpp'
RSS feed for 'csharp'
RSS feed for 'css'
RSS feed for 'delphi'
RSS feed for 'design'
RSS feed for 'drupal'
RSS feed for 'excel'
RSS feed for 'facebook'
RSS feed for 'flash'
RSS feed for 'html'
RSS feed for 'java'
RSS feed for 'javascript'
RSS feed for 'joomla'
RSS feed for 'iphone'
RSS feed for 'mysql'
RSS feed for 'photoshop'
RSS feed for 'php'
RSS feed for 'python'
RSS feed for 'ruby'
RSS feed for 'seo'
RSS feed for 'sql'
RSS feed for 'sysadm'
RSS feed for 'translate'
RSS feed for 'typing'
RSS feed for 'twitter'
RSS feed for 'vbnet'
RSS feed for 'xml'
RSS feed for 'wordpress'
RSS feed for 'writing'
New!
Проекты на русском
(Projects in Russian)

Short URL:
1001fp.com
Mobile version:
m.1001freelanceprojects.com
Copyright © 2005-2025 1001 Freelance Projects