Gowtham

Hi, I'm Gowtham

Senior Software Engineer — Python | Data Pipelines | Automation | LLM

About Me

I am a Senior Software Engineer with 7+ years of experience in Python scripting, backend automation, and web scraping. I specialize in building scalable data pipelines using Scrapy, Airflow, and Docker.

Passionate about turning unstructured data into actionable insights, I'm currently exploring AI and LLM-driven automation for real-time data processing.

🚀

Gowtham's Mission

To build intelligent, end-to-end automation systems that combine data engineering, AI agents, and cloud-native technologies — transforming fragmented data into real-time, actionable insights that power smarter business decisions.

Projects

Data pipelines, automation systems, and AI-powered solutions

Featured
🚗

JATO Car Data Pipeline

🚗 Vehicle Pricing Data 🤖 AI-Powered Processing

Automated vehicle pricing pipeline with Scrapy, Airflow, MySQL, Docker & OpenAI API. Streamlines data collection and processing for automotive industry insights.

✓ Automated Data Collection ✓ Workflow Orchestration ✓ AI Data Processing ✓ Containerized Deployment
Python Scrapy Airflow MySQL Docker OpenAI API
📊 Dashboard 📂 GitHub 📚 Docs
📝

Prosepulse Article Generator

🤖 AI-Powered Content ⚡ FastAPI Backend

AI-powered content generation system using Python, FastAPI & Cosmos DB. Automates article creation with intelligent content processing and database management.

✓ AI Content Generation ✓ FastAPI Integration ✓ NoSQL Database ✓ Automated Processing
Python FastAPI Cosmos DB AI Content Automation
📝 Demo 📂 GitHub
🏢

StorTrack Data Crawler

🌍 Global Data Collection ☁️ AWS S3 Integration

Global self-storage unit data scraper & sync system with AWS S3 integration. Automated data collection and synchronization for storage facility analytics.

✓ Global Data Scraping ✓ AWS S3 Storage ✓ Data Synchronization ✓ Automated Processing
Python Scrapy AWS S3 Automation Data Sync
🕷️ Demo 📂 GitHub
🔄

ETL Automation Demo Project

🔄 Complete ETL Pipeline 🐳 Dockerized Setup

Complete ETL automation demonstration showcasing data extraction, transformation, and loading using modern data engineering tools and best practices.

✓ End-to-End ETL Pipeline ✓ Workflow Orchestration ✓ Containerized Deployment ✓ Version Control Integration
Python Scrapy SQL Docker Airflow Git
📂 View on GitHub 📚 Documentation

Professional Experience

7+ years of Python development with enterprise-scale achievements

💼

Senior Software Engineer

Merit Data and Technology Pvt Ltd
01/2024 - Present

The company focuses on data solutions and technology. Leading end-to-end data extraction pipelines using Python and Scrapy for pricing intelligence.

🔄 Leading end-to-end data extraction pipelines using Python and Scrapy
📊 Developed structured outputs from unstructured web sources
🚀 Integrated Apache Airflow and Docker into scraping workflows
⚡ Automated scheduling and improved scalability
Python Scrapy Apache Airflow Docker Data Pipelines Pricing Intelligence
🔧

Senior Software Engineer

Mafionis Software Solutions Pvt Ltd
05/2023 - 11/2023

Software solutions provider specializing in data analytics and web tools. Built and deployed scalable web scrapers for market intelligence data.

🕷️ Built and deployed scalable web scrapers for market intelligence
🔗 Designed internal-use API endpoints using FastAPI and Flask
⚛️ Collaborated with front-end developers for React-based dashboards
📈 Delivered market intelligence data solutions
Python FastAPI Flask Web Scraping React Integration Market Intelligence
🏢

Software Engineer (Contract to Hire for Infosys)

ARS Solutions Pvt Ltd
02/2023 - 04/2023

IT service management provider. Resolved issues raised via Jira dashboards related to web scraping pipelines.

🎯 Resolved issues via Jira dashboards for web scraping pipelines
🐛 Handled bug fixes and enhancements for Scrapy-based spiders
💼 Integrated into LinkedIn's data ingestion processes
🤝 Collaborated with QA and data teams for clean batch deliveries
Python Scrapy Jira LinkedIn Integration Data Ingestion QA Collaboration
🌱

Python Developer

Aggregate Intelligence Pvt Ltd
07/2018 - 01/2023

Data analytics company providing insights and tools for various industries. Developed scalable web scrapers to extract structured data from industry-specific sources.

🕷️ Developed scalable web scrapers for industry-specific data extraction
☁️ Integrated AWS S3 for data storage and serving
📊 Built data solutions for internal teams and client reporting
🏭 Worked across various industry verticals
Python Web Scraping AWS S3 Data Analytics Client Reporting Industry Solutions

Skills & Technologies

Technical expertise in Python, data engineering, and automation systems

7+
Years Experience
15+
Technologies
3
Major Projects
100%
Automation Focus
🐍

Core Technologies

Python Expert 7 years
Scrapy Advanced 5 years
FastAPI / Flask Intermediate 2 years
SQL Advanced 5 years
☁️

DevOps & Cloud

Docker Advanced 4 years
Git / GitHub Expert 7 years
AWS S3 Intermediate 3 years
Apache Airflow Intermediate 2 years
🗄️

Data & AI

MySQL / PostgreSQL Advanced 5 years
MongoDB Intermediate 2 years
OpenAI API Beginner 1 year
N8N Automation Beginner 1 year

🏆 Certifications

🤖

AI Automation: Build LLM Apps & AI Agents with n8n & APIs

Udemy • 2025

🔄

Complete Hands-On Introduction to Apache Airflow

Udemy • 2025

Let's Work Together

Have a project in mind? I'd love to hear about it!

Get In Touch

Email

gowthamjohn7@gmail.com

📱

Mobile

+91 7550335512

Social

Send a Message