Overview
The Web Exploration Engine (WEE) is designed to improve the way businesses and individuals extract and utilise critical website information. By leveraging web scraping technologies and natural language processing (NLP), WEE provides a seamless and efficient solution for gathering, analysing, and presenting data.
Business Need
In today's digital landscape, having access to timely and accurate web data is crucial for making informed business decisions. For DNS clients and the DNS industry at large, WEE provides an invaluable tool for gaining insights into domain-related trends and activities. By analysing data scraped from relevant websites, DNS clients can identify emerging trends, gain insights into their customer base, and make strategic decisions regarding new domain registrations and market positioning.
Key Features
- Scheduled Scraping
- Reputation Management
- User-Friendly Interface
- Competitor Comparison
Technologies
Project Overview Documents
Project Summary
Project Day 🤩
Awards
Tech Odyssey was awarded the DevOps Adherence Prize and the Innovative Use of Data Prize after project deliberation and voting. We're honoured to have been the only team to take home more than one prize!Devops Adherence Prize
This award recognises our team's exceptional implementation of DevOps principles throughout our project lifecycle. We demonstrated continuous integration and deployment, automated testing, and efficient collaboration between development and operations teams. Our streamlined workflow and commitment to best practices in version control, monitoring, and infrastructure as code set a high standard for DevOps excellence.
Innvoative Use of Data Prize
This award celebrates our creative and effective approach to data utilisation. Our project stood out by leveraging complex datasets in novel ways, implementing advanced analytics, and deriving meaningful insights that drove our application's functionality. We employed cutting-edge data visualisation techniques and machine learning algorithms to transform raw information into valuable user experiences, demonstrating the power of data-driven development.
Tech Odyssey 🥰
Reflection
Having had some experience with configurations and CI/CD pipeline setups, I entered the capstone project eager to learn as much as possible and expand my understanding of the operations side of software development.
Throughout this journey, configuring the pipeline, conducting our performance and scalability tests, and working with virtualisation technologies challenged me to deepen my understanding of various technologies for the sake of accomplishing our objectives.
Collaborating with tools like Grafana, Loki, and Sentry really showed me the immense value we can get from continuous monitoring and as I saw first hand how crucial these elements were for maintaining our system's health and keeping our users happy.
As I look back on the project and reflect on everything our incredible team has done, I realise that all we have implemented and learned has allowed me to develop a really comprehensive and full understanding of what DevOps is - and it has made me really excited to see the DevOps experiences I will be part of in the future.