Contact us
Send us your idea to discover how we can help you bring it to life.
Phone: + 1 213 401 2829
Email: sales@emphasoft.com

Ai comprehensive database creator

Bot which creates a database from any website
Industry
Research
Geography
USA
Type
Web
Technologies
Machine Learning
Project overview:

AI startup that indexes the entire web - provides Diffbot Knowledge Graph (DKG) query services in Google Sheets and Microsoft Excel to instantly enrich existing user databases with comprehensive and publicly available information about companies and organizations. The main challenge was to build the best extraction API to process pages found by Crawlbot
The following features were identified for functionality expansion:

  • human-level recognition with no manual exploration or input.
  • the ability to quickly and efficiently obtain data on a large sample of people/companies
  • a diagram of connections with other entities
  • unlike traditional web scraping tools, Diffbot doesn't require any rules to read the content on a page
  • implementation of bulk request option. The ability to quickly and efficiently obtain data on a large sample of people/companies
Emphasoft engagement:

Our team joined in 2020 with 2 fullstack developers.
Our team members mainly worked with Java and Cloud frameworkes 

Number of our contractors:
1 Back end
1 Front end
1 QA testing

Usually 1-2 people were simultaneously attached to the project. Our key responsobilies was to create side infrastructure stuff.

Key results:

  • Distributed, world-class crawling infrastructure processing millions of pages daily.

  • Plug-and-play scraping and Knowledge Graph access

  • Clean structured data (such as JSON or CSV), ready for use

  1. Innovation: Yandex, Microsoft, Amazon and other market titans use Diffbot
  2. Ai, ML: Implementation of innovative technologies allows for scaling the bot to any amount of content. Content is interpreted by a machine learning model trained to identify the key attributes on a page based on its type
  3. Data management and storage: used MySQL, opportunity to send bulk requests. High speed of work.
  4. Content update: platform is able to update the information and build a knowledge base.
Case Studies
Web application development for procurement platform How outsourcing an MVP helped a fintech company secure its round
Web platform for business networking Event management SaaS platform developed from scratch
Video application from scratch Video service for connection IT and Digital professionals with clients
AI and computer vision platform for facial recognition Web and mobile app for face identification
Improvement of the fitness mobile app Turnkey solution for professional fitness app
Face recognition platform Platform with ability to detect and match persons
Private web and mobile browser The browser that provides strong data security.
Cleaning Startup Complete IT-solution for enhancing a new business
Physician AI and scribe system New era patient care management system
Web application for weather analytics company Platform that allows to access wind speed data from weather stations
Educational platform designed for students and tutors Сustomizable student and tutor matching service
Event-marketing Platform Integration Developing a custom application for Zapier
Constrafor IT-solution for a procurement platform
Web application for an online-school Launching online-school project
Data extraction CRM Custom CRM for web data extraction from a social network
UI/UX design for AI supermarket app Frictionless, personalized retail solutions
Investment agency Web application for investment agency
Web application for IoT IoT Web interface on AWS infrastructure
AtmoCube - IoT solution for complex air quality monitoring Development of Internet of Things infrastructure for air sensors.
Web application for NMG Charity Challenge Web application to facilitate activity tracking
Bis website Business partner search system
Team Tracker Plugin for developer activity tracking
Lead management system Leads management system for real estate agents
Park Place Realty service for sellers and investors
Parsing Application Upgrading the framework
Levelgoals Mobile application for smart income management
Therapass - smart platform to connect a therapist and a patient. Professional application development for healthcare industry
Online platform for cigar enthusiasts community The most explicit place for cigar lovers. Learn, share, review, communicate
Speed Networking - communication web service Platform to connect people for fast and beneficial experience exchange
Staff management, data collection, aggregation, visualisation Effective time management for a green corporation
Sourcefit - smart management platform for business Development of complicated web-applications
Development of AI-based SaaS products AI meeting assistant for business
buttonSchedule a Discovery Call buttonSchedule Call