web 800x507 A Fully Dockerized MySQL to YugabyteDB Migration Strategy Using pgloader 768x487 1

A Fully Dockerized MySQL to YugabyteDB Migration Strategy Using pgloader

A Fully Dockerized MySQL to YugabyteDB Migration Strategy Using pgloader 768 487 Exist Software Labs

While there have been many who began their journey to relational databases with the simple and popular MySQL, the evolution of business use cases involving more than read optimization and the need for more performant, full-fledged, read/write-optimized OLTP systems have given rise to a widespread migration from MySQL to Postgres.

Along with this, the transition from monolithic to cloud-native has also paved the way for distributed SQL systems that allow for read/write functionality in every node of the database cluster (while maintaining ACID-compliance across all nodes) and cloud-agnostic deployments of these nodes across geographic zones and regions. This is the future of the database, a future where reliability, accessibility, and scalability are built into the product. The future of the database is YugabyteDB.

From MySQL to YugabyteDBfast!

The method that we will be using to migrate a MySQL database to YugabyteDB is through the use of pgloader, a very reliable tool for migrating from MySQL (even SQL Server) to Postgres. We will first migrate the MySQL database to a Dockerized Postgres instance using Dockerized pgloader.

Once the MySQL database has been migrated to Postgres, we will then use the ysql_dump utility that comes with every installation of YugabyteDB to dump the Postgres database into a YugabyteDB-friendly format. This is one of the very useful traits of ysql_dump: it ensures that your Postgres dump can be fully restored in a YugabyteDB instance.

After getting the dump, we will restore this dump in the blank YugabyteDB database that we’ve created beforehand, thereby completing the migration from MySQL to YugabyteDB!



1. Get the Postgres Docker container

docker run -e POSTGRES_HOST_AUTH_METHOD=trust -p 5432:5432 -d postgres:11

2. Create the MySQL database counterpart in Dockerized Postgres


3. Run Dockerized pgloader to load from MySQL to Dockerized Postgres

docker run --rm --name pgloader dimitri/pgloader:latest pgloader --debug mysql://<user name>:<password>@<ip address of MySQL DB server>:3306/<source database name> postgresql://postgres@<ip address of Dockerized Postgres>:5432/<destination database name>

*If a user error is encountered, make sure the user and IP address combination indicated in the error is created in the MySQL source and has access to the databases to be migrated.”

4. Since pgloader creates a Postgres schema using the database name and puts the tables there, we can change the schema name to “public”

     l_old_schema NAME = '<schema name>';
     l_new_schema NAME = 'public';
     l_sql TEXT;
     FOR l_sql IN
          format('ALTER TABLE %I.%I SET SCHEMA %I', n.nspname, c.relname, l_new_schema)
     FROM pg_class c
          JOIN pg_namespace n ON n.oid = c.relnamespace
     n.nspname = l_old_schema AND
     c.relkind = 'r'
     RAISE NOTICE 'applying %', l_sql;
     EXECUTE l_sql;
     END LOOP;

5. In this example, we will be using Dockerized Yugabyte as the destination (also applies to other form factors)

a. 1-node cluster with no persistence: 

docker run -d --name yugabyte  -p7000:7000 -p9000:9000 -p5433:5433 -p9042:9042 yugabytedb/yugabyte:latest bin/yugabyted start --daemon=false

b. With persistence:

docker run -d --name yugabyte  -p7000:7000 -p9000:9000 -p5433:5433 -p9042:9042 -v ~/yb_data:/home/yugabyte/var yugabytedb/yugabyte:latest bin/yugabyted start --daemon=false

6. Go inside the Yugabyte container

a. To access the interactive terminal of the container:

docker exec -it <yugabyte container id> /bin/bash

b. Go to the bin directory:

cd /home/yugabyte/postgres/bin

c. Make sure destination database exists in YugabyteDB:

CREATE DATABASE <destination yugabytedb name>;

d. Dump the database in the Postgres container:

./ysql_dump -h <ip address of Postgres container> -U postgres -d <database name of postgres db> -p 5432 -f <dump name>.sql

e. Restore the Postgres dump in the blank database in the YugabyteDB instance:

./ysqlsh -p 5433 -d <database name of destination yugabyte db> -f <dump name>.sql


And there you have it! You have successfully migrated your MySQL database to the future of the database. You have migrated to YugabyteDB!

yugabytedb migration

Exist is your data solutions partner of choice!

Explore the next level of your digital transformation journey with big data and analytics. Let’s look at opportunities to better maximize your ROI by turning your data into actionable intelligence. Connect with us today, and we’ll proudly collaborate with you!

Enterprise Database

The Future of the Database: YugabyteDB

The Future of the Database: YugabyteDB 768 487 Exist Software Labs

The journey to application modernization brought about by the cloud-native renaissance continues, and the benefits to be had are truly being enjoyed by the enterprises that embrace the path. Speed, scalability, resiliency, and agility may seem to just be industry buzzwords, but in reality, they translate to better application deployment, performance, and availability, which further translate to what really matters: happy customers.

This has given way to the concomitant need for databases to adapt to this need for speed, scalability, resiliency, and agility. The way traditional databases have implemented a single-node access to the database cluster via the master node has proven untenable in a commercial environment wherein the need to scale users, not just locally, but across the regional and geographical divide, has become dire and ubiquitous.

This is where the gap is filled by YugabyteDB.


What is YugabyteDB?

What is YugabyteDB?

YugabyteDB is a transactional, distributed SQL database that was designed primarily to possess the virtues of the cloud-native philosophy. Its creators wanted a chiefly OLTP database that was fast, easy to add more nodes to, able to tolerate node failures, upgradable without incurring any downtime, and deployable in all form factors (public/private cloud, VMs, and on-prem).

Being a distributed SQL database, it has automatic distribution of data across nodes in a cluster, automatic replication of data in a strongly consistent manner, support for distributed query execution so clients do not need to know about the underlying distribution of data, and support for distributed ACID transactions.

It is a multi-API database that exposes the following APIs (more will be added in the future): 

  • YSQL – an ANSI SQL, fully-relational API that is completely compatible with PostgreSQL 11.2
  • YCQL – a semi-relational SQL API that is based on the Cassandra Query Language

It is a Consistent and Partition Tolerant (CP) database in that in the event of a network partition within the database cluster wherein one of the nodes cannot communicate with the other nodes and determine majority membership, data consistency over availability is prioritized by the system and this node will not be able to accept writes, whereas the nodes that are still part of the majority will remain unaffected.

It is completely open source, released under the Apache 2.0 license.


What are the key benefits of YugabyteDB?

The following are some of the benefits that are immediately enjoyed “out-of-the-box”:

  • No single point of failure given all nodes are equal
  • Distributed transactions across any number of nodes
  • Scale write throughput linearly across multiple nodes and/or geographic regions.
  • Low-latency reads and high-throughput writes.
  • Strongly consistent, zero data loss writes.
  • Cloud-neutral deployments with a Kubernetes-native database.
  • Automatic failover and native repair.
  • 100% Apache 2.0 open source even for enterprise features.

In other words, you get a cloud-native, transactional, distributed SQL database system that allows you to read and write on every node in the cluster (with ACID assurance), distribute your application load across many nodes in many regions and geographies, read and write data fast, deploy anywhere, and be highly available—all in open source!


Use Cases

YugabyteDB is perfect for:Use Cases of YugabyteDB

Just this morning, social media personality, James Deakin, posted on his FB wall about a particular bank whose “app feels like it’s running on windows 95” (his own words). He ended up closing his account due to the overall poor customer experience brought on by the subpar performance of this bank’s client-facing, internet applications, along with other concerns.

YugabyteDB is perfect for the client-facing, Internet, transactional application.

Want to know more about the Yuggernaut of Distributed SQL? Contact us.

Exist is your data solutions partner of choice!

Explore the next level of your digital transformation journey with big data and analytics. Let’s look at opportunities to better maximize your ROI by turning your data into actionable intelligence. Connect with us today, and we’ll proudly collaborate with you!

web 800x507 8tech 768x487 1

8 Most Impactful Tech Breakthroughs throughout 2010s – Part 1

8 Most Impactful Tech Breakthroughs throughout 2010s – Part 1 768 487 Exist Software Labs

The 2010s somehow fueled the fastest technological evolution by far. It is a leeway to the rise, and fall of some of the most ground-breaking technologies. We have witnessed the digital world cementing a whole new ground atop the one we had walked on in prior decades.

Despite its backlashes, we cannot deny that it phenomenally transitioned different lenses that we revolve around; social, political, economic, cultural, and etcetera. Buckle up as we take a recap on some of the most significant technological upgrades that occurred within the just concluded decade.

The previous decade kicked-off with promising innovations that were still at its infancy. These innovations took a little time but bloomed into the market around the 2010s, big time! Perhaps, most people can even say that it is almost unimaginable to take it away from the current lifestyle.


It is everywhere, right? People of all ages got one at hand acquiring it for different purposes. But for most, smartphones have been a necessity. The history of smartphones goes back to the ’90s with IBM’s Simon Personal Communicator. According to, the touchscreen device was said to make its user “computer functional” as it offered functions like e-mail, fax, and predictive typing. Simon was indeed ahead of its time and inspired the rest of the technology world to adapt.

There have been more attempts to popularize smartphones. But it was not until Apple’s introduction of its first-ever iPhone when it finally made it happen. It sold millions of units within just one (1) year. From this point on, smartphone units by different companies came out one after another and kept on getting better every time. As of now, Apple and Samsung are leading the pack, but other brands are also coping up at a fast pace.

Social Media

Facebook, Twitter, Instagram, Youtube; these are just some of the platforms that became a huge part of our everyday lives. But how it made an impact on a personal level is just a portion of how it changed the world, holistically speaking. Even the biggest of big entities join the social matrix wherein they see to it that employees, customers, clients, partners, and other networks alike are reached out through different social media platforms. It also opened the door for business opportunities with the introduction of virtual market places and social media marketing.

Social media also forged the way to faster information dissemination. We see real-time updates and can promptly respond to it. The latest news is always out there, both fake and legit making it a double-edged sword for its users. On one end, it raises awareness, informs, and warns people, but it also spreads hoax like a wildfire.

Big Data

The term “big data” is nothing new to our world. It appeared in passages although used in a different context than what we know of today.

The world shifting into a digital one is the strongest booster of big data technology. Nowadays, almost everything involves data gathering. A nanosecond amounts to billions of data. However, big data is most effective with advanced analytics. Otherwise, it is just a pile of information that might or might not serve its value.

Internet of Things (IoT)

From businesses to households, smart devices have been conquering all possible corners. Where the internet is, smart devices go as well. IoT directly uploads bits of data to the net even in the absence of human interference. Imagine that. For some, it poses security threats. But regardless of what its original purpose is, we cannot deny that it aids in minimizing human effort.

With this at hand, we could say that the growth in the production of smart devices equates to bigger data. Therefore, big data tools are highly significant to IoT, whereas big data systems need volumes of structured or unstructured data for its analyses. These two are complementary; one works better with the other.

Artificial Intelligence

“Artificial intelligence” has been a long-buzzing area of interest. It is the creation of systems to replicate human activities. Alexa, Siri, and Google Assistant are perhaps the most digestible examples of AI in action. The rise of voice assistants is one step towards the full employment of AI, as seen in the growing investments in the said field. After being one of the most anticipated technologies for a long while, we could finally say that AI is on its way to its prime.

Cloud-Native Technology

Here is another bummer tech in the 2010s. Cloud-native platforms have been working behind the curtains but are among the most important upgrades in this age of digitization.

Cloud-native applications mainly promote portability, reliability, and speed. Because of this, one can work off-site with no hassle; systems are running at maximum speed thus providing a faster process. It has been winning over on-premise business management and will most definitely impose dominance in no time. 

Businesses most likely experience the benefits of moving to cloud-native applications. An IBM research published in 2018 shows that corporations plan to move 75 percent of its non-cloud applications to cloud within three (3) years. This only suggests that utilizing cloud-native technology is becoming a priority for enterprises.

Mobile Payment

The market welcomed this system with open arms. The soft cash has become more preferred than actual money. With mobile devices everywhere, it quickly earned its merits. It is a fast and convenient method of transaction, so why not?


A system that allows a person to earn extra from a personal vehicle and offering a ride to someone who needs one is a Win-Win scenario. The transportation industry had a huge progression with the rise of car-sharing. It did not solely provide convenience to its users but also aided in other automotive-related problems such as parking spaces and traffic.

There may be more innovations that earned names for themselves in the past decade. But the ones mentioned in this list had an immense impact on our everyday lives and still got some room to venture in for the coming years. In the second part of this series, we will be diving into how these technologies might grow even bigger in the coming years.

web 800x507 pivotal 1 768x487 1

Exist To Help Spread Cloud-Native Revolution Across APAC at the Pivotal Summit 2019

Exist To Help Spread Cloud-Native Revolution Across APAC at the Pivotal Summit 2019 768 487 Exist Software Labs

Manila, Philippines, Nov 08, 2019 — Exist Software Labs, Inc., a global consulting and IT solutions Philippine market leader is set to join Pivotal Software, leading cloud-native platform provider, in its annual roadshow summit in two key cities in Singapore and Japan this November.

Taking place at the Marina Bay Sands in Singapore on November 14 and at Roppongi Hills in Tokyo on November 26, visitors can catch Exist at the Sponsors booth area. The team will highlight its technical and innovative expertise as an upcoming key Pivotal partner ready to help Asia-based enterprises build and operate software at startup speed.

“As a technology leader, we are committed to helping spread the use of advanced technologies that enable companies to digitally transform how they manage and deliver software and data. Our track record of designing and implementing solutions spans the Asia region and it makes perfect sense that we join Pivotal as it showcases new technologies that power enterprise-grade clouds and help developers ship code more frequently,” narrates Mike Lim, Exist president and CEO.

Spanning across five countries, the APJ Pivotal Summit 2019 gives business leaders in the Asia-Pacific and Japan region valuable facetime opportunity to meet with expert Pivotal speakers and industry thought leaders in both traditional presentation and informal conversations about the latest developments in Development and Operations (DevOps), Continuous Integration and Continuous Delivery (CI/CD), application development, cloud architectures, legacy modernization, and more.

“We marvel at Pivotal’s ambitious mission which is to transform how the world builds software and we believe that we are capable of providing end-to-end support in reaching this goal. This means that with Pivotal, we can help clients across every industry in Asia, innovate on how they use software to meet their own respective business goals as well,” Mr. Lim exclaimed.

At every summit stop, visitors and conference attendees will learn about the latest developments in DevOps, CI/CD, application development, cloud architectures, legacy modernization. Technical managers or executives looking to educate themselves will pick up the latest software development tools and methods to help transform their teams.

Business track
Learn how organizations and governments can transform the way they build and run their most important software applications leveraging a cloud-native platform, developer tools, data insights, and modern methodologies.

Technical track
Listen to speakers discuss the best cloud-native Java content from the flagship SpringOne Platform 2019 conference. Learn about both traditional monolithic and modern, cloud-native Java from the source.

“We are excited to be side-by-side with Pivotal in helping customers in Asia launch their digital transformation initiatives. With their cloud-native platform plus data tools together with our tried and tested agile methodology, we can help provide a complete solution for forward-thinking businesses who look to software for their success,” explains Mike.

You can learn more about the APJ Pivotal Summit 2019 Singapore here and APJ Pivotal Summit 2019 Japan here.

Ftrd Pic 1 768x487 1

Becoming the ‘Big Fish’: Pivotal Steps Up the Game with Its 4x-Bigger New Office

Becoming the ‘Big Fish’: Pivotal Steps Up the Game with Its 4x-Bigger New Office 768 487 Exist Software Labs

Pivotal, the go-to provider of cloud-native platform, developer tools, and unique methodology to help the world’s largest enterprises transform the way they build and run their most important applications, opened its new office in Funan at the Wework Offices last Sept 19, 2019.

Moving into the new space four times bigger than the previous office, it houses amenities where innovation teams can get together and create wonderful applications.

20190919 101248 a

Jonas Lim, Exist’s Vice President for Engineering and I represented the Philippines & Exist Software Labs. The impressive space can house client team members as well in what they call “Dojos” – a training quarters used in martial arts training, this time used in the building of modern software.

Present in the event were Pivotal President Bill Cook, Senior Vice President for Products & Marketing Ian Andrews, Vice President and Managing Director of Asia, Pacific and Japan Lionel Lim, and General Manager of Partners & Alliances in APJ KM Tan. We also met up with other Singapore team members; Sachin, Shaun, David, Dennis, and Nam along with the APJ regional officers in Korea, China and from Pivotal Japan, Andrew Lee, Yanagihara-san, Kobayashi-san, and Takashi-san.

1571293066562 a

Curtained space encased Pivotal Labs’ clients, having Pivotal engineers pair up with clients and do knowledge transfer of best practices and learning the pivotal process for application development and platform implementation.

This is a very important concept for success learned – “The Big Fish”. In a pond, the small fish always gets eaten by the big fish. In the corporate context, if a new process needs to be adopted, this new process should be in an environment wherein it will be the “big fish” devouring the old practice from the client team, the “small fish” which leads to the transformation into the new Pivotal process. Once the company gets strong enough and better established, it can go back to its old environment with a higher rate of success to thrive and propagate the new process.

20190919 101252 a

At Exist, we implemented one of the first and largest ever Pivotal Cloud Foundry (PCF) installed here in the Philippines for a Government project. The application uses designed and containerized microservice and cloud-native architecture that is meant for the management, monitoring and accelerating the processing of the documents importation handled by multiple agencies to process port entries of goods and containers. It has been rolled out to 14 agencies already and will still be rolled out to other agencies.

Fulfilling Exist’s mission to provide cutting edge technologies to provide a competitive edge to our client is one of the key reasons why our large enterprise clients chose Exist as their innovation partner in the implementation of their digital transformation strategy.

In the opening ceremony, a Lion dance was performed as a Chinese tradition for good luck, health, blessing, and prosperity and to bring positive energy in the space. In performing this, paints are being dotted onto the lion’s body. The first to be dotted will be in the mirror at the front of the lion’s head. This is known as the “third eye”. Then, it will be followed by the nose so that it can breathe and smell deals from all over. Next will be inside the mouth. Next, the ears to be able to listen to clients’ needs, the eyes to be able to see more deals. Lastly, it will be dotted all over its body – from its head to have the wisdom to successfully help in achieving clients’ goals and satisfaction, down to its neck, tail and finally, the limbs. The Lion Dance was performed all around the space to spread the blessing.

20190919 111821 a

It is such a wonderful experience overall to be able to be around key people from the industry and we look forward to creating amazing stories with them from this new home towards the new frontier of Cloud-native and modern architecture for applications.