introduce

Data Pipeline Overview

What is "CORE Project" ?

"CORE" projects stand for Continuous Optimization for Robust Engineering.

"CORE project" is a project that integrates successive tasks in a continuous direction from start to finish in the perspective of creating the project.

The overall work of a project can require many different tasks, and the core project is the point of contact for connecting all of those individual tasks.

The chains of tasks of collecting data, processing it, and publishing the results in the form of designs can be more organized.

Improving productivity through integration is a core value of Core Projects.

What can we do with CORE Project ?

We can do anything you can imagine with a CORE project. We're dedicated to helping you bring your most creative ideas to reality.

Here are a few creative examples. When someone walks into a Los Angeles real estate listing, they're greeted with a sign that flashes the location and price on and off, giving them an immediate sense of what they're seeing.

The steps involved in this process are to get an account with access to the MLSDB of US real estate information, periodically collect market price information and move it to a MySQL database, create the signage design in Frame, create the looping parts as blocks, and assemble the Frame and blocks in Layout.

You can then use the Page feature in UI/ Component to set the moving time of the screen and the category of the page.

Like the example above, data collection via MLSDB can also be scheduled and automated using Web Crawler.

In another example, you may be unhappy with your existing WordPress admin page and want a clearer, lighter admin program.

The CORE Project has an automatic code generator that allows you to simply select a database, specify fields, and press the Generate Code button, and it will automatically suggest programs for the input modify delete view CRUD.

If you press control+s on a suggested program, the program will be saved, implemented through the website, and made available for immediate use.

Which are each of the service components and what do they support?

A CORE Project works with a set of service components that are organically connected, and each service component can perform the following functions.

Main Category Service Component Function
Contents Web Crawler Management of retrieving data
Contents Parser Rule Create criteria for data interpeter and perform a pipeline of post-processing tasks after analysis
Contents Dataset Connect to multiple services with database access and additional information
Contents Cell Editor A tool for quick editing of simple data. Also an editor with clipboard capabilities and particular merits in usability.
Contents Database Editor Enables you to solve problems with large amounts of data through SQL Query statements.
Designed for high availability.
Especially considered connectivity with APP Pipeline.
Contents Database API Endpoint You can quickly and easily express various forms of structural design in JSON format.
Contents Media Library You can upload a variety of media and utilize them in a unified way across your services.
Contents App Functions It is designed to maximize accessibility to the input and iteration process in the input iteration output, which is the basis of the function.
Layouts Layout It's a tool that allows you to create different layouts by combining fixed frames and repeating blocks like a Lego puzzle.
Display Scene A tool that imports and orchestrates a variety of data to optimize the exhibitory elements of a screen.
Service Single Program A service platform that allows you to quickly create simple programs and apply them to lightweight purposes.
Service Project A tool that allows programs to be developed and tested in a virtual environment with multiple development aids.
It is designed to minimize the time taken for the development-test-implementation process.
Service Program Editor It is an integrated development tool that fulfills many of the needs of a development environment.
Service Code Builder This is an automated development tool designed to minimize the time it takes to develop.
Simply select the fields you need from your dataset, click the build button, and it will suggest the source code.
Service Preset Project It is a solution that allows you to produce a child project out of a project.
The preset project provides an interface to input more automation options from the producer's perspective.

Classification by accessibility

Service Component Direct access HTML CSS JS Asset Manager Virtual Tests Auto Deployment
Media Library Yes No No No No No No
Layout - Frame Yes Yes Yes No No No No
Layout - Block X Yes Yes No No No No
Layout - Page Yes Yes Yes No No Yes No
Display - Scene Yes Yes Yes No No Yes No
Single Program Yes Yes Yes Yes No Yes Yes
Program in Project Yes Yes Yes Yes Yes Yes Yes
API Endpoint ACL No No No No Yes No
Parser No No No No No Yes No
2023 © Copyright Reserved.