Abdalla Ahmed

Abdalla Ahmed

ETL Developer

About Me

I am self-taught enthusiastic programmer. Exploring the wilderness of software development and technology with much passion at my own pace. I have full-time job in Oil & Gas sector as production engineer and I work flexible hours as ETL/Data Engineer in Upwork freelancing platform. Currently seeking a position in software development to apply my knowledge and experience with a professional team. My services include but not limited to:

  • Web Scraping and Web Research
  • Data Mining/Data Processing/Data Cleansing
  • Task Automation and integrating hosting solutions (Heroku, Amazon EC2, digital ocean)
For most of my projects I use programming languages e.g. (Python, JS, mySQL) with libraries (bs4, selenium, requests, flask) and utilities (SQL, SQLite) hosting services (Heroku, Amazon EC2, digitalocean).

Age
31
Email
a.a.devmail@gmail.com
Phone
+2 01000 233 819
Address
Al Dkahliya, Egypt

Professional Skills

Python
Linux/Bash
HTML & CSS
Git
PHP
Django
SQL
JQuery
JavaScript
C++

Work Experience

Freelance ETL Developer Freelance
August, 2018 - Present
Working on many ETL projects for different types of clients. Go to list of projects
Production Engineer (unrelated) at Gempetco
March, 2018 - Present
Directly supervising and reporting oil and gas production processes. I have built many automation tools in this position that helped me and my colleagues increase quality and effectiveness of our reporting system.
Technical Office Engineer (unrelated) at Jeddah Foundation Company
July, 2012 - March, 2018
Worked with my technical office team in 300 employees contracting company on following up across the country projects. Followed up projects starting from submitting the initial proposal to the awarding, execution planning until the end of the construction project.

Education

Bachelor of Engineering at Suez Canal University
2008 - 2012
Studies in the faculty of engineering in Suez Canal Univeristy. My major was in oil and gas exploration and production. However, I have studied many courses related to CS and scientific programming (Matlab) and some Oil & Gas related Software (Petrel E&P, OFM)

Projects

Craiglist Real Estate Bot
The project was meant to be done manually. However, I created and maintained a bot to automatically list real estate ads in craiglist. Needed to scrap structured/unstructured listing data from daily incoming email and post them to client's craiglist account without any human interaction. Main challenge was to bypass Craiglist bot detection system with no extra cost charged to the client.
Client Feedback: "Abdalla is great to work with and I highly recommend him. We hired him to post ads for us to various platforms. He was quick to learn and very adaptable. We switched the platforms where we posted our ads a few times and each time he learned very quickly how to post to those platforms. Further to that point, once we set Abdalla up on the posting platforms he would work well and quietly in the background without the need for micromanagement. He communicated well and took any constructive feedback might have had very well. I would definitely work with Abdalla again in the future!"
Twitter Trends Bot (Egypt)
I made a bot that continually capture top 8 trends in Egypt and tweet them.
Client Feedback: Currently the bot have more than 2300 followers.
AliExpress Scraper
The client had previously built scraper for several e-commerce websites. My job was to integrate Selenium module to specifically scrap AliExpress product page. Because I was working with a team of developers in this project I had to commit to my team certain standards, workflow and documentation.
Client Feedback: "Abdalla Ahmed successfully completed our web scraping request in Python & Selenium in the agreed timeline and communicated daily on the progress and challenges faced. Already during interview stage he made us aware on other potentially overlooked details and therefore helped us to clear the scope. He was busy on another project when contacted initially but left it to us to choose if we want to wait for our turn or proceed with other freelancers instead. We appreciated the honest feedback and choose him and agreed to queue up accordingly. We could not be happier with the result and the process to get there. The result does what it supposed to do and was executed well within agreed timeline and budget. Positive to point out is the regular and proactive communication done by Abdalla Ahmed. Well done Abdalla Ahmed! We could not be more satisfied and recommend you!"
Medical Students Test Booking Scraper
I built scraping and notifier system. It was used by medical students to book their certificate evaluaiton tests. Test seats/slots were very rare to appear and were momentarily booked by large number of students around the world waiting for it to appear. I have done the following steps to successfully build the scraper:
  1. Created multiple accounts in the test registration website
  2. Used these accounts along with ip rotation to constantly bypass captcha -> sign in -> search for test seats (use custom country/city or date preferences if any).
  3. If a test seat appeared, my script take screen shot and send it along with organized test data (date/country/city/test type) to users via a telegram bot.
  4. The telegram bot had subscription system that only send notifications to subscribed users.
  5. Later on I improved the system by allowing it to automatically book the test seat if valid credentials were provided.
Client Feedback: I had peak of around 30 happy subscribers to the system.
Cloud Based Website Scraper
My client needed to fetch and warehouse monthly updates (json data) of a website into a database which he can access online and download specific portions of the data frequently. I hosted my project in ec2 aws instance. It was django dashboard allowing the client to access the database and download the data.
Client Feedback: "Really enjoyed working together. He is smart, quick, and able to help you anticipate alternative approaches based on his experience."
Generic Email Addresses Crawler
Built a crawling bot to crawl websites for email addresses. The bot is structure agnostic, it will farm email addresses from the home page regardless of the page structure, once the page is completed the bot will search for deeper links in the page to another pages of the website and do the same to each link excluding duplicates.
Client Feedback: "Great communication and job overall!!"
Cleansing and Transforming 10,000,000 xlsx Rows
Client data was clustured in around 60 xlsx files. My job was to cleanse nearly 10,000,000 data rows and structure them in MySql db.
Client Feedback: "He did amazing work! Far exceeded my expectations. Every step of the way he paid great attention to detail, and asked me questions any time I was unclear about something or when problems arose, to make it all got done correctly. I highly recommend him to anybody looking for scraping services."
PDF Files Splitter
Did this project for one of my siblings that usually needed to split pdf files for his work. Used python with django.