Feng Yu
Data Scientist/Web Scraper In Python
Flushing,NY
Summary
I am a highly skilled Network Spider Engineer with a Master's degree in Information Technology and experience as a Data Scientist/Web Scraper. I have extensive knowledge of third-party dependency libraries for Python and experience performing async scraping. Additionally, I am proficient in JavaScript reverse engineering, including the use of HOOK technique to make a breakpoint and supplementary methods for the JavaScript browser environment.
Overview
4
4
years of professional experience
6
6
years of post-secondary education
Work History
Data Scientist/Web Scraper
E
commerce
06.2019 - Current
- Sync Scraping
- Used third-party dependency libraries for Python, such as Requests, Beautiful Soup, and re, etc
- To crawl the required data from a specified URL
- Async Scraping
- Used third-party dependency libraries such as asyncio, aiohttp, multiprocessing, queue, etc
- To crawl the required data from a specified URL
- JavaScript Reverse Engineering
- DOM breakpoint, XHR/Fetch breakpoint
- Use HOOK technique to make a breakpoint
- Supplementary methods for the JavaScript browser environment
- Use crypto-js in JavaScript to reverse MD5, SHA, AES function
- Use node-rsa in JavaScript to reverse RSA, DSA encryption
- Reverse Obfuscator, JJEncode, Ook!, etc., Source code available upon request Self-employee
- Application market data scraping
- Platform data scraping
- Live streaming traffic analysis
- E-commerce data monitoring
- Short video content scraping
Education
Associate of Science - Fashion Design
GENY
New York, NY 05.2017 - 05.2018
Associate of Science - Web Design
GENY
New York, NY 05.2015 - 05.2017
Master of Science - Accounting
Southern New Hampshire University (SNHU)
Manchester, NH 04.2013 - 05.2015
Master of Science - Information Technology
Southern New Hampshire University (SNHU)
Manchester, NH 05.2008 - 05.2009
Bachelor of Engineering - Automation Science and Electrical Engineering
BeiHang University (BUAA)
Skills
Python
JavaScript
SQL
HTML/CSS
Pycharm
Adobe Photoshop
MySQL
MongoDB
Machine learning
MS Office
NodeJS
Charles
Django
Flask
Scrapy
Tensor Flow
Pandas
Timeline
Data Scientist/Web Scraper
E
06.2019 - Current
Associate of Science - Fashion Design
GENY
05.2017 - 05.2018
Associate of Science - Web Design
GENY
05.2015 - 05.2017
Master of Science - Accounting
Southern New Hampshire University (SNHU)
04.2013 - 05.2015
Master of Science - Information Technology
Southern New Hampshire University (SNHU)
05.2008 - 05.2009
Bachelor of Engineering - Automation Science and Electrical Engineering
BeiHang University (BUAA)