Skip to content

Reddit scraper without API#1116

Merged
avinashkranjan merged 1 commit into
avinashkranjan:masterfrom
RohiniRG:RohiniRG-scrapereddit
May 28, 2021
Merged

Reddit scraper without API#1116
avinashkranjan merged 1 commit into
avinashkranjan:masterfrom
RohiniRG:RohiniRG-scrapereddit

Conversation

@RohiniRG

@RohiniRG RohiniRG commented May 25, 2021

Copy link
Copy Markdown
Contributor

Description

Using BeautifulSoup, a python library useful for web scraping, this script helps to scrape a desired subreddit to obtain all relevant data regarding its posts.

Fixes #1104

Type of change

Please delete options that are not relevant.

  • Bug fix (non-breaking change which fixes an issue)
  • New feature (non-breaking change which adds functionality)
  • This change requires a documentation update
  • Documentation Update

Checklist:

  • My code follows the style guidelines(Clean Code) of this project
  • I have performed a self-review of my own code
  • I have commented my code, particularly in hard-to-understand areas
  • I have created a helpful and easy to understand README.md
  • My documentation follows Template for README.md
  • I have added the project meta data in the PR template.
  • I have created the requirements.txt file if needed.

Project Metadata

If there is no-file/nothing to fill the below fields with, then type: none

Example: If no requirements.txt needed/present, then type none in Requirments.

Category:

  • Calculators
  • AI/ML
  • Scrappers
  • Social_Media
  • PDF
  • Image_Processing
  • Video_Processing
  • Games
  • Networking
  • OS_Utilities
  • Automation
  • Cryptography
  • Computer_Vision
  • Fun
  • Others

Title: Reddit scraper without API

Folder: Reddit_scraper_without_API

Requirements: requirements.txt

Script: fetch_reddit.py

Arguments: None

Contributor: RohiniRG

Description: This script helps to scrape the desired subreddit to obtain all relevant data regarding its posts.

@RohiniRG

Copy link
Copy Markdown
Contributor Author

@kaustubhgupta @santushtisharma10 please have a look

@kaustubhgupta kaustubhgupta added the next review needed Approved by some mentors, more approvals needed label May 26, 2021

@Kushal997-das Kushal997-das left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM 👍

@santushtisharma10 santushtisharma10 added Approved PR Approved and Ready to Merge gssoc23 Issues created for/by the GirlScript Summer of Code'23 Participants level2 Bug fixing, Adding small features and removed next review needed Approved by some mentors, more approvals needed labels May 28, 2021

@avinashkranjan avinashkranjan left a comment

Copy link
Copy Markdown
Owner

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM..💯

@avinashkranjan avinashkranjan merged commit 77ae12d into avinashkranjan:master May 28, 2021
@avinashkranjan avinashkranjan added the manual-db-update-req The PR was merged but db was not updated. Need to update the database manully label May 28, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Approved PR Approved and Ready to Merge gssoc23 Issues created for/by the GirlScript Summer of Code'23 Participants level2 Bug fixing, Adding small features manual-db-update-req The PR was merged but db was not updated. Need to update the database manully

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Reddit Scraper without API

5 participants