Case studies

Resources

Lyft Increases Simulation Capacity, Lowers Costs Using Amazon EC2 Spot Instances

Lyft Level 5

About Lyft Level 5

Lyft, one of the largest transportation networks in the United States and Canada, is on a mission: improve people’s lives with the world’s best transportation. Along with its focus on shared rides, bike-share systems, electric scooters, and public transit partnerships, Lyft launched its Level 5 autonomous vehicle (AV) division in 2017 as part of its effort to achieve this mission. Using petabytes of data gathered from its AV fleet, Lyft’s engineers run millions of simulations each year to improve the performance and safety of its self-driving system.

But those simulations are compute-intensive, and Lyft knew it would need massive computing power that could scale up and down at an affordable price. The company, which has been using Amazon Web Services (AWS) for its rideshare platform since the day it launched in 2012, turned to AWS again to boost its compute capacity and lower costs, ultimately choosing a combination of Amazon Elastic Compute Cloud (Amazon EC2) Spot Instances and Amazon Elastic Kubernetes Service (Amazon EKS) for its AV simulation workload.

Running Simulations on Amazon EC2 Spot Instances

Running simulations on thousands of graphics processing units (GPUs) in parallel is critical to Level 5’s success in testing and improving how AVs respond to various driving situations. “Simulation is one of the key ways we improve the safety of our software before it goes anywhere—even a test track,” says Timothy Perrett, senior staff engineer at Lyft Level 5. Exploring the simulation space (such as varying the speed, position, or vehicle dynamics) requires repeated testing and thus a lot of computing flexibility.

Early on, it was clear that Level 5 would have very different computing needs than Lyft’s rideshare business. “Level 5 has different needs and constraints,” says Perrett. “Most of our computing needs are in servicing large, batch-style workloads that have a very spiky profile. We need the ability to burst up to high peak loads and then quickly turn everything down when we’re not using it.”

Lyft could have invested in on-premises central processing units and GPUs, but the Lyft team’s prior experience on AWS made the AWS Cloud its first choice. So the testing began. Level 5 engineers started by utilizing capacity from Amazon EC2 On-Demand Instances, in conjunction with Amazon EKS, the fully managed Kubernetes service that AWS offers.

After experimenting with running simulations using On-Demand Instances, Lyft’s Level 5 team quickly realized it could improve efficiency and reduce costs by shifting to Amazon EC2 Spot Instances. Now more than 90 percent of the simulations run on Amazon EC2 Spot Instances, including Amazon EC2 P3 Instances powered by NVIDIA V100 Tensor Core GPUs, and that enables Lyft to take advantage of unused Amazon EC2 capacity in the AWS Cloud at up to a 70 percent discount compared to On-Demand pricing. “When we experimented with running on Amazon EC2 Spot Instances, we realized that as our program was growing quickly, there was an opportunity to significantly reduce our operational costs,” says Perrett.

Enabling Simulations to Run Efficiently

The Level 5 team distributes its simulation workload in what Perrett calls a “clever dance” to ensure that simulations still run even when Amazon EC2 Spot Instances aren’t available because of high demand. Engineering staff observed which clusters—and pools within those clusters—operated efficiently and took into account regional zone usage. “We became smarter about how we allocate work and how we relocate jobs in a given resource pool on a given day,” Perrett notes. The team used Amazon EKS to prioritize and scale resource pools so jobs were efficiently using instances.

The engineering team was also careful to design systems so that simulations would function on a variety of hardware, depending on what was available—something Lyft calls fleet diversity. Perrett explains, “We put a lot of effort into making our stack work on whichever type of instance is available—Amazon EC2 P3 Instances versus the Amazon EC2 P2 Instances, for example.” This flexibility helps Level 5 engineers avoid having to wait to schedule simulations, even when demand is high.

Lyft also has to manage a massive amount of data gathered from simulations and from its AV fleet, and it takes advantage of Amazon Simple Storage Service (Amazon S3) to store and access an ever-expanding dataset as Lyft increases the number of sensors on its test vehicles. Gathering and storing all that information from its AVs and simulations amount to petabytes of data, and transferring that amount of data directly to the cloud, as the Level 5 team did in the early days, was costly. To reduce that cost, Lyft uses AWS Direct Connect, a dedicated network connection between its Level 5 engineering center and its cloud systems. “We have a very high-capacity network that connects to the places where we operate our AV fleet,” Perrett notes. “And then we upload the data for a much lower cost per petabyte.”

By carefully partitioning and directing its simulation traffic on Amazon EC2 Spot Instances, Lyft’s Level 5 engineering team reduced the cost of simulations to just pennies for each execution. “About 77 percent of our computing fleet across all Level 5 workloads—and over 90 percent of our AV simulation workload—is now on Amazon EC2 Spot Instances, and the cost savings overall has been around two-thirds,” says Perrett. “We were able to scale up our computing capacity significantly while reducing the overall cost of operation.”

Benefits of AWS

● Reduced compute costs by two-thirds
● Scaled up computing capacity significantly
● Increased velocity of development for AVs

AWS Services Used

Amazon Elastic Compute Cloud (Amazon EC2) is a web service that provides secure, resizable compute capacity in the cloud. It is designed to make web-scale cloud computing easier for developers.

Amazon EC2 Spot Instances let you take advantage of unused EC2 capacity in the AWS cloud. Spot Instances are available at up to a 90% discount compared to On-Demand prices. You can use Spot Instances for various stateless, fault-tolerant, or flexible applications.

Amazon EKS is a fully-managed Kubernetes service. EKS runs upstream Kubernetes and is certified Kubernetes conformant so you can leverage all benefits of open source tooling from the community.

Conclusion

Running millions of simulations at steep cost savings on AWS allows Lyft’s engineering team to run its tests from inside its offices, enabling staff to gain confidence in software changes prior to taking physical vehicles out in the real world. “Simulations are a more cost-effective means of validating software changes compared to taking a vehicle to the test track,” Perrett says. “This improves iteration time for engineering staff and helps improve safety and software quality on a shorter time horizon.”

Instead of using On-demand Instances, using Spot Instances is one of the suitable solutions to help businesses optimize operating costs while ensuring business operations. If you are having problems related to EC2 cost, try to use Spot Instances, your business will definitely save a lot of money.

About VTI Cloud

VTI Cloud is the Advanced Consulting Partner of AWS in Vietnam, with a team of more than 50+ AWS certified solution engineers. With the desire to support customers in their digital transformation journey and moving to the AWS cloud, VTI Cloud is proud to be a pioneer in solution consulting, software development, and deployment of AWS infrastructure for customers in Vietnam and Japan.

Building secure, high-performance, flexible, and cost-optimized architectures for customers is VTI Cloud‘s primary mission in the mission of enterprise technology.

Reference: https://aws.amazon.com/vi/solutions/case-studies/Lyft-level-5-spot/?nc1=f_ls

CEC Improves Business Decision-Making and Performance Visibility Using SAP on AWS

Dịch chuyển SAP lên Cloud - CEC đẩy nhanh việc ra quyết định kinh doanh và tăng hiệu năng sử dụng

“We have a great opportunity to learn more about the ways in which the AWS Cloud can help us be more efficient and agile as a company and respond quickly to business opportunities.” – Kevin Chueh, Vice President of IT, CEC, says.

About CEC

Continental Engineering Corporation (CEC) is widely recognized as one of Taiwan’s prominent contractor and developer, excelling in major public and private-sector construction as well as long-term land and community development. CEC is one of only a handful of companies licensed in Taiwan to engage in both construction and development.

Using Data to Build a Better Business

In the construction industry, there are numerous risks. If a large construction project overruns, costs can stretch to millions of dollars, and accidents on construction sites can be fatal. Large construction companies like Continental Engineering Corporation (CEC) in Taiwan require huge amounts of materials, like concrete and steel, to complete projects, and small fluctuations in prices can eat away at margins. To help control risks, construction businesses rely on IT to help personnel carefully manage the complexity of building projects, onsite safety, and purchasing. CEC, for instance, uses a SAP Enterprise Resource Planning (ERP) system to store its data and serve end-of-month reports the company needs.

Cloud for Peace of Mind

Traditionally, CEC ran SAP and all its IT systems on premises but looked to migrate to the cloud. The move, which began in 2018, was triggered by servers in the data center approaching end-of-life. Kevin Chueh, vice president of IT at CEC, says, “It was an opportunity to modernize our IT and move to a more flexible infrastructure.” CEC believed the cloud could reduce its costs through a pay-as-you-go model and give the company the power to scale up its infrastructure for month-end reporting when work was most hectic. What’s more, CEC could run SAP on powerful cloud-based servers optimized for large ERP systems and get better performance out of the software, avoiding the upfront costs of refreshing CEC’s aging servers.

CEC looked for a cloud service provider to support the migration and chose Amazon Web Services (AWS). Chueh comments, “We didn’t need long to decide on the cloud service provider. The AWS Cloud was more mature than the clouds of competitors and running SAP on AWS gave us peace of mind.”

A Well-Thought-Out Collaboration

CEC worked with Taiwan’s CKmates, an AWS Partner Network (APN) Advanced Consulting Partner, to lead the migration. CKmates also joined forces with CEC’s technology partner, which supports its SAP systems. Together they spent one month defining the AWS infrastructure to support the SAP system, and two months on a proof of concept (POC). They then spent another month refining the infrastructure based on the results of the POC before pressing ahead with the migration. Kane Pan, ERP systems manager at CEC, says, “The project was well managed from end to end, with CKmates and our technology partner collaborating well and ensuring we stayed on schedule.”

Delivering a Powerful Stack

The company’s SAP applications run on Amazon Elastic Compute Cloud (Amazon EC2) R5 instances, which are designed for memory-intensive systems like SAP ERP. The R5 instances are powered by AWS Nitro System, which delivers virtually all the compute and memory resources the host hardware has to offer. CEC’s SAP database sits on Amazon Elastic Block Store (Amazon EBS), whose single digit–millisecond latency is suited to high-performance database workloads. In addition, CEC uses Amazon Simple Storage Service (Amazon S3) for SAP backups.

Pan says, “The time period between a construction project’s inception and its completion can be many years, so projects tend to accumulate a lot of data, all of which needs processing multiple times. Amazon EC2 R5 instances were ideal because of their capacity to hold data when generating reports. Pulling out 8–10 years’ worth of data on a construction project was no problem with these instances.”

CEC still runs some applications on premises and uses AWS Direct Connect to enable the free flow of data between the cloud-based SAP solution and its on-premises applications. It’s only a temporary measure while CEC plans its all-in migration to the AWS Cloud. Chueh adds, “We’re currently investigating whether our older applications can run on the cloud. Nevertheless, our long-term goal is to migrate everything to AWS.”

Generating Reports up to 83% Faster

Since the company migrated SAP to the AWS Cloud, its ERP system’s performance has increased. Month-end reports that used to take 1–2 hours to generate are now delivered in 10–20 minutes. Because personnel know reports can be generated so quickly, they are asking IT to produce more of them, thereby getting a deeper level of insight into areas of the business where more details were needed. “Knowing more about how all areas of CEC are operating will help us make better business decisions,” says Chueh. “We’ve had great feedback from our finance and accounting department because of the way this makes their lives easier.”

CEC - AWS Infrastructure

Seizing the Opportunity to Increase Agility While Saving Time and Cost

Compared with on premises, the cost of running SAP on the AWS Cloud is about 10 percent lower. Furthermore, the IT team is saving time managing its SAP environment instead of its data centers. In the few months since the migration, CEC has also seen a reduction in network latency of 30 percent and backups are 5 percent quicker. The cost and time savings are being reinvested in the IT team learning more about AWS services to accelerate the development of CEC’s cloud environment. Chueh concludes, “We have a great opportunity to learn more about the ways in which the AWS Cloud can help us be more efficient and agile as a company and respond quickly to business opportunities.”

  • Delivers SAP ERP reports up to 83% faster
  • Reduces IT costs by 10%
  • Lowers network latency by 30%
  • Cuts backup times by 5%
  • Presents opportunity to increase agility

CEC - Trích xuất báo cáo từ SAP ERP nhanh hơn đến 83%

 

AWS Services Used

Amazon EC2 R5 instances:

Amazon EC2 R5 instances are the next generation of memory optimized instances for the Amazon Elastic Compute Cloud. R5 instances are well suited for memory intensive applications such as high performance databases, distributed web scale in-memory caches, mid-size in-memory databases, real time big data analytics, and other enterprise applications.

Amazon Elastic Block Store:

Amazon Elastic Block Store (EBS) is an easy to use, high performance block storage service designed for use with Amazon Elastic Compute Cloud (EC2) for both throughput and transaction intensive workloads at any scale. A broad range of workloads, such as relational and non-relational databases, enterprise applications, containerized applications, big data analytics engines, file systems, and media workflows are widely deployed on Amazon EBS.

Amazon Simple Storage Service:

Amazon Simple Storage Service (Amazon S3) is an object storage service that offers industry-leading scalability, data availability, security, and performance. Amazon S3 is designed for 99.999999999% (11 9’s) of durability, and stores data for millions of applications for companies all around the world.

AWS Direct Connect:

AWS Direct Connect is a cloud service solution that makes it easy to establish a dedicated network connection from your premises to AWS. Using AWS Direct Connect, you can establish private connectivity between AWS and your datacenter, office, or colocation environment, which in many cases can reduce your network costs, increase bandwidth throughput, and provide a more consistent network experience than Internet-based connections.

Kết luận

“We have a great opportunity to learn more about the ways in which the AWS Cloud can help us be more efficient and agile as a company and respond quickly to business opportunities.” – Kevin Chueh, Vice President of IT, CEC, says.

If you’re planning to migrate your existing systems to AWS to reduce costs and improve performance, migrate your SAP S/4HANA, or modernize your business processes with AWS services, we’re always willing to assist you. 

About VTI Cloud

VTI Cloud is the Advanced Consulting Partner of AWS in Vietnam, with a team of more than 50+ AWS certified solution engineers. VTI Cloud is proud to be a pioneer in assisting businesses in both Japan and Vietnam in their journey of digital transformation and moving to the AWS cloud.

Building secure, high-performance, flexible, and cost-optimized architectures for customers is VTI Cloud‘s primary mission in the mission of enterprise technology.

To learn more, visit aws.amazon.com/sap.

Reference: https://aws.amazon.com/solutions/case-studies/cec/?did=cr_card&trk=cr_card

KAPLAN & AWS – How to solve the cost optimization problem in the education field?

tối ưu chi phí

About Kaplan

Kaplan, Inc. serves more than 1.2 million students globally each year through its array of higher education, test preparation, professional education, English-language training, university preparation, and K-12 offerings to individuals, institutions, and businesses. Throughout its 75-plus year history—first as a test-prep pioneer, then an early online-education leader, and now a global education provider—Kaplan has been recognized for expanding educational access and using technology and learning science innovations to continually improve outcomes for its students and partners. Kaplan has operations in more than 30 countries, employs more than 22,000 professionals, and maintains relationships and partnerships with more than 1,000 school districts, colleges, and universities, and more than 2,600 corporations and businesses. Kaplan is a subsidiary of Graham Holdings Company and its largest division.

The challenge

Today Kaplan consists of many divisions with varying IT infrastructure needs and fluctuating usage patterns, including Kaplan’s Test Prep division (KTP), which prepares students for admissions tests like the SAT, ACT, GRE, GMAT, LSAT, MCAT, and professional licensing exams. To support KTP, Kaplan was running its development and testing environments in Tier 1 collocated data center in New York City. When Tropical Storm Sandy, one of the deadliest and most destructive storms of the 2012 Atlantic hurricane season, swept through the city, the hosting center went down for approximately two weeks.

“Thankfully, our production environment remained operational, but having to worry about what could happen was always on our mind,” says Kaplan Executive Director of Technology Services Chad Marino. Kaplan’s manual backup and recovery resources were also based in New York City. “Having our backup environment in the same city as our production environment is also a major concern that needed to be addressed,” explains Marino.

Additionally, as the business grew in size and its IT architecture increased in complexity, it became progressively difficult for Kaplan to meet the Payment Card Industry Data Security Standard (PCI DDS) and service organization control (SOC) compliance. Kaplan needed to find a flexible IT infrastructure that would allow it to grow while improving overall resiliency, security, and agility.

Why Amazon Web Services

Kaplan was running 12 different data centers across the organization and started moving its applications to Amazon Web Services (AWS) to consolidate its infrastructure. According to Marino, “One of the things driving us to move to the cloud was dealing with end-of-life hardware and running out of space in our data center.”

Kaplan was also attracted to the maturity of AWS offerings. “Amazon Relational Database Service (Amazon RDS) allows our DBA team to focus less on the day-to-day maintenance and use their time to work on enhancements. And Elastic Load Balancing has allowed us to move away from expensive and complicated load balancers and retain the required functionality,” says Marino.

Migrating to the AWS Cloud

Tropical Storm Sandy prompted the company to migrate KTP and additional shared services, part of the Kaplan Higher Education and Kaplan International divisions, to AWS, totaling up to 900 GB of data. “We started in May 2013 by moving the development, quality assurance, and staging environments to AWS,” says project manager Ravi Munjuluri. “We completed that part of the transition by October and began planning the production migration. By January 2014, we began moving the pieces of the application stack in the production environment over one by one to minimize the impact on the business. Our final push was in August and it all occurred over a weekend. We started on Friday and were up and running by Sunday morning.”

As part of the move to the cloud, Kaplan migrated about 50 applications and 50 nested sub-applications in its stack. In the collocated data center, the division used a storage area network (SAN) to connect to x86 servers, Sun Sparc processors, and the Solaris operating system to six Oracle Database 10g and Windows SQL databases.

Kaplan migrated its application stack to Amazon Virtual Private Cloud (Amazon VPC), hosting the databases on a mix of Amazon Elastic Compute Cloud (Amazon EC2) instances using Amazon Linux Machine Images and Amazon Relational Database Service (Amazon RDS) for Oracle. Marino says, “Our goal is to move completely to RDS for all databases for ease of management and resizing capabilities.”

To monitor its resources, Kaplan uses Amazon CloudWatch, a service that collects and tracks usage metrics and manages alarms. Using Amazon CloudWatch also allows the company to optimize its resources by, for example, right-sizing its instances when utilization rates fall.

Best Practices for Migrating to the Cloud

The Kaplan team designed the migration of data around Oracle’s built-in tools. “We used AWS PERL scripts to migrate the data, which were really great,” says Avi Hack, director of systems architecture and engineering. With the combination of scripts and AWS Elastic Beanstalk, the company was able to automate time-consuming processes and pre-stage the migration environment, which made the overall process much faster and easier.

As part of its migration, Kaplan decided to leverage multiple AWS regions and Availability Zones, including some in the United States, Asia Pacific, and Europe. The company uses Amazon Route 53 as its DNS solution to route user traffic to the nearest Availability Zone and as a result improve the overall user experience, reducing latency. “Using multiple regions allows us to put our data closer to the customer for a better end-user experience,” says Marino.

Kaplan’s preparation made much of the transition to AWS seamless. Kaplan also leaned on AWS Support, Business-level, throughout the migration for acknowledgment and best practices. “Leveraging AWS Support has been key in addressing issues that we may experience,” says Marino.

More than 250 people from development, operations, architecture, and database teams were involved in the migration to AWS. “In order to plan a migration of this size, it is critical to work with all teams within IT to pull it off, from development down to the infrastructure operations team,” says Marino.

After moving the KTP division to AWS, Kaplan sold the legacy equipment and closed the data center. The company continues to re-architect applications for various divisions as it continues migrating to AWS, and today Kaplan has reduced its data center footprint from 12 to 4 facilities.

The Benefits

Besides a more reliable infrastructure and less latency, Kaplan has also gained better insight into the cost of its applications and systems. “By tagging all instances in AWS, we are now able to look at specific costs from the application layer down to every resource associated with an application. This has allowed us to surface the hidden costs for operating applications,” says Marino.

Kaplan anticipates further improvement to the development process using AWS. Hack says, “By using AWS CloudFormation and the AWS Command Line Interface (CLI), we have a level of control and standardization that we could not achieve within our on-premises data centers. We can now easily spin up environments and remove them when we are finished with them.” Marino explains, “This allows us to take advantage of the strength of AWS while maintaining the strengths of our on-premises data center, and gives our developers the time to retool our applications to run on AWS.” The Kaplan team says it will continue to look for opportunities where it makes sense to move systems and applications away from traditional data centers and into the cloud.

Conclusion

As a leader in global education, Kaplan has chosen AWS to accompany them in their transformation journey from on-premises infrastructure to cloud. Kaplan has achieved the tremendous benefits of cost control, user experience, resizable capacity, and business performance.
If your business is in the education field and needs consulting on AWS cloud services, let our experts assist you!

About VTI Cloud

VTI Cloud is the Advanced Consulting Partner of AWS in Vietnam, with a team of more than 50+ AWS certified solution engineers. With the desire to support customers in their digital transformation journey and moving to the AWS cloud, VTI Cloud is proud to be a pioneer in solution consulting, software development, and deployment of AWS infrastructure for customers in Vietnam and Japan.

Building secure, high-performance, flexible, and cost-optimized architectures for customers is VTI Cloud‘s primary mission in the mission of enterprise technology.

Reference: https://aws.amazon.com/vi/solutions/case-studies/kaplan/

Deliveroo – Reduce operating costs by more than 50% with AWS

tối ưu chi phí

About Deliveroo

Founded in 2013, Deliveroo works with more than 80,000 restaurants, delivering meals in over 500 cities across Europe and Asia. The company serves a three-sided marketplace of customers, restaurants, and 60,000 delivery riders. Success means understanding the needs of all three parties and balancing them so that all are satisfied.

Deliveroo relies on Amazon Web Services (AWS) in every part of its core business: accepting orders, transmitting them to restaurants, and delivering meals to customers.

AWS’s scalable infrastructure helps Deliveroo meet the fluctuating demands of delivering food in 12 markets worldwide, while machine learning (ML) and data analytics services provide the intelligence to manage delivery logistics and offer customers personalized restaurant recommendations.

The challenge

Deliveroo’s demand fluctuates, with order volume spikes at lunch and dinner times, as well as special days, such as Valentine’s Day or the Game of Thrones finale, which can see demand increase by up to 400 percent. And because Deliveroo operates in multiple countries, it deals daily with multiple, sometimes overlapping, peaks. During World Cup tournaments, for instance, order numbers spike in different countries on different days, depending on who’s playing, as well as on Muslim feast days such as Eid al-Fitr.

When Deliveroo turned to AWS in 2017, this was a key challenge. Using AWS has allowed Deliveroo to meet demand and improve service quality, reducing food delivery times by 20 percent while also cutting costs.

The solution

Dealing with the spikes is just one of its challenges though. Deliveroo turned to AWS to prepare for the future and differentiate with a great customer experience, as well. To meet demand on backend and frontend apps, it moved to a containers architecture based on Amazon’s Elastic Container Service (ECS) and Elastic Kubernetes Service (EKS) for the load balancing, monitoring, and storage it needed. It also migrated its PostgreSQL databases to Amazon Aurora, with its improved throughput and scalability. A serverless architecture using Amazon DynamoDB to publish into managed Kafka clusters now meets Deliveroo’s variable demand on backend and customer-facing apps.

Testing Times

Every day is a test for a growing business. But Deliveroo was truly tested when 80 percent of Europe’s restaurants closed during COVID-19 lockdowns and demand for food delivery as much as tripled.

Food delivery is a highly competitive, low-margin business at the best of times. Deliveroo needed a solution that balanced speed and customization with the need to make money, especially during the uncertainty of the pandemic lockdown. Mike Rogers, senior engineering manager of Platform Group at Deliveroo, says this is where the AWS experience shone.

“From my viewpoint, this is where the relationship really came in. We said, ‘we’re not interested in growth right now, we’re interested in cash flow.’ AWS gave us different cost-reduction models and brought in people who could think about different things. It was really valuable, when things were down, to minimize the cashflow out, and then as we came back out of lockdown, we had different challenges.”

One way Deliveroo saved money was by scaling down little-used features. For example, the personalized list of suggested restaurants—auto-generated per user—was shorter as many restaurants closed, so it consumed fewer resources. Those resources were shifted to meet increased demand for the home page.

“With the flexibility of AWS, we can say we want to scale not just the entire operation up or down, but on a feature-by-feature basis. Being able to say how we want each one to respond to change in demand is pretty huge,” says Sprunt.

That flexibility lets Deliveroo keep innovating.

The company introduced new services, such as grocery delivery, during lockdown. Afterward, it scaled up deliveries and launched a new table service that allows customers to order food and pay for meals in a restaurant without interacting with staff.

Benefits of AWS

  • Reduced food delivery times by 20%
  • Flexible response to surges
  • Reduced costs
  • Better personalization
  • More efficient dispatch
  • Improved ML training

AWS Services Used

Amazon SageMaker is a fully managed service that provides every developer and data scientist with the ability to build, train, and deploy machine learning (ML) models quickly. SageMaker removes the heavy lifting from each step of the machine learning process to make it easier to develop high quality models.

Amazon Elastic Container Service (Amazon ECS) is a fully managed container orchestration service. Customers such as Duolingo, Samsung, GE, and Cookpad use ECS to run their most sensitive and mission critical applications because of its security, reliability, and scalability.

Amazon Elastic Kubernetes Service (Amazon EKS) is a fully managed Kubernetes service. Customers such as Intel, Snap, Intuit, GoDaddy, and Autodesk trust EKS to run their most sensitive and mission critical applications because of its security, reliability, and scalability.

Amazon DynamoDB is a key-value and document database that delivers single-digit millisecond performance at any scale. It’s a fully managed, multiregion, multimaster, durable database with built-in security, backup and restore, and in-memory caching for internet-scale applications.

Conclusion

Deliveroo is one of the many businesses that have experienced AWS services and achieved impressive business results. If your business has ever had any difficulties in operation and cost, do not hesitate to contact VTI Cloud for our support!

About VTI Cloud

VTI Cloud is the Advanced Consulting Partner of AWS in Vietnam, with a team of more than 50+ AWS certified solution engineers. With the desire to support customers in their digital transformation journey and moving to the AWS cloud, VTI Cloud is proud to be a pioneer in solution consulting, software development, and deployment of AWS infrastructure for customers in Vietnam and Japan.

Building secure, high-performance, flexible, and cost-optimized architectures for customers is VTI Cloud‘s primary mission in the mission of enterprise technology.

Reference: https://aws.amazon.com/solutions/case-studies/deliveroo-case-study1/?did=cr_card&trk=cr_card


Lever Uses AWS Global Accelerator to Boost Performance for Recruiting Software

About Lever

Based in California, Lever provides recruiting software, an applicant tracking system, and recruitment marketing tools used by top businesses throughout the world. Thousands of hiring managers worldwide rely on Lever software to find, nurture, and manage their job candidates in a central location. Lever, a San Francisco–based company, provides an applicant tracking system used by recruiters in all industries. “We offer a complete, real-time collaborative platform for managing the entire hiring process, from sourcing potential candidates and gathering résumés to scheduling interviews and hiring,” says Charlie O’Leary, the infrastructure engineering manager for Lever.

Since its founding, Lever has run its application environment on the Amazon Web Services (AWS) Cloud, taking advantage of services including Amazon Elastic Compute Cloud (Amazon EC2) for on-demand compute capacity, Amazon Simple Storage Service (Amazon S3) for storing customer data, and Amazon Elastic Kubernetes Service (Amazon EKS) to manage and orchestrate containers. “We chose to run on AWS from day one because we knew it would enable us to grow our business quickly and focus on the software instead of infrastructure management,” says O’Leary.

As Lever added more customers in new global regions, it wanted to increase application performance and address latency issues that resulted from the company having a presence in only the AWS US West Region. “We had customers in India and elsewhere in Asia seeing latency issues, so they weren’t benefiting from the real-time features of our software,” O’Leary says. “As a result, they weren’t moving candidates through quickly enough and were worried about losing potential hires to other companies.”

Deploying AWS Global Accelerator for Europe and Asia

To reduce latency for its customers, Lever began using AWS Global Accelerator, a service that improves application availability and performance. AWS Global Accelerator provides static IP addresses that serve as a global fixed entry point to application endpoints such as Application Load Balancers in one or more AWS Regions. It takes advantage of the AWS global network to optimize the path from users to applications, which boosts the performance of IP traffic, whether TCP or UDP. “We were very excited when AWS Global Accelerator was announced,” says O’Leary. “We had tried doing some things on our own to improve latency, but without any results. Global Accelerator seemed very promising.”

By using AWS Global Accelerator, Lever gains better application failover capabilities by optimizing routing and simplifying management. “If something were to happen in the US West Regions, we would quickly and seamlessly fail over to other AWS Regions in less than 30 seconds to ensure we’re backing up our customers’ critical data,” says O’Leary.

Lever initially used AWS Global Accelerator for customers in Europe. “It was very simple to set up the service, and we saw dramatic latency improvements in minutes,” states O’Leary. Lever then deployed AWS Global Accelerator for customers in India, Southeast Asia, Japan, and Australia.

Reducing Application Load Times by More Than 50%

Lever customers across the globe have seen significant latency improvement and better overall performance since Lever began using AWS Global Accelerator. “Lever helps companies attract, source, and hire talent, and thousands of recruiters depend on our product daily,” says Eric Hwang, staff software engineer at Lever. “Simply by enabling AWS Global Accelerator, one multinational customer saw a 51.2 percent reduction in mean end-to-end app load times, week over week.”

Other Lever customers in Asia and Europe have also seen 50 percent load-time reductions when running Lever software. “Our global customers noticed the performance difference right after we enabled AWS Global Accelerator,” remarks O’Leary. “The application loaded faster, and the customers saw less latency in the real-time collaborative features. Overall, customers reported a smoother, more reliable experience.”

As a result, Lever customers can move job applications through the system faster. “Our customers receive thousands of job applications through our software every day, so being able to move those applications through different stages quickly is critical,” says O’Leary. “Recruiting is a very competitive industry, with many companies vying for the same pool of candidates. If our customers can’t access updated information on each person quickly enough, they could lose that candidate to another company. Using AWS Global Accelerator ensures that we get the best performance and lowest latency for our software, so our customers don’t lose out on hiring the candidates they want to hire.”

Giving Developers More Agility to Roll Out Features Faster

Lever also benefits from the agility of the AWS Cloud, which gives the company’s developers more time to focus on creating software features and enhancements. “We only have three people on my team, and we want to do project work instead of troubleshooting and managing infrastructure,” says O’Leary. “By relying on AWS, we are able to rapidly spin up proof-of-concept environments to test new tooling in hours versus the days or weeks it would take in a data center.” As an example, Lever is currently building new reporting features to meet customer demand for data analytics. “We can quickly build those tools and share them with users to get instant feedback,” states O’Leary. “Along with the performance improvements we’re seeing with AWS Global Accelerator, this is another example of how AWS is helping us better serve our customers.”

Benefits of AWS

  • Reduces application load times by more than 50% for global customers
  • Helps recruiters track applicants more efficiently
  • Spins up testing environments in hours instead of days or weeks
  • Enables failover to other AWS Regions in under 30 seconds

AWS Services Used

AWS Global Accelerator is a service that improves the availability and performance of your applications with local or global users. It provides static IP addresses that act as a fixed entry point to your application endpoints in a single or multiple AWS Regions, such as your Application Load Balancers, Network Load Balancers or Amazon EC2 instances.

Amazon Elastic Compute Cloud (Amazon EC2) is a web service that provides secure, resizable compute capacity in the cloud. It is designed to make web-scale cloud computing easier for developers. Amazon EC2’s simple web service interface allows you to obtain and configure capacity with minimal friction. It provides you with complete control of your computing resources and lets you run on Amazon’s proven computing environment.

Amazon Simple Storage Service (Amazon S3) is an object storage service that offers industry-leading scalability, data availability, security, and performance. This means customers of all sizes and industries can use it to store and protect any amount of data for a range of use cases, such as websites, mobile applications, backup and restore, archive, enterprise applications, IoT devices, and big data analytics.

Amazon Elastic Kubernetes Service (Amazon EKS) is a fully managed Kubernetes service. Customers such as Intel, Snap, Intuit, GoDaddy, and Autodesk trust EKS to run their most sensitive and mission critical applications because of its security, reliability, and scalability.

To learn more, visit aws.amazon.com/global-accelerator.

About VTI Cloud

VTI Cloud is the Advanced Consulting Partner of AWS in Vietnam, with a team of more than 50+ AWS certified solution engineers. With the desire to support customers in their digital transformation journey and moving to the AWS cloud, VTI Cloud is proud to be a pioneer in solution consulting, software development, and deployment of AWS infrastructure for customers in Vietnam and Japan.

Building secure, high-performance, flexible, and cost-optimized architectures for customers is VTI Cloud‘s primary mission in the mission of enterprise technology.

Reference: https://aws.amazon.com/vi/solutions/case-studies/lever-case-study/

WELL-ARCHITECTED REVIEW SERVICE

well-architected review vti cloud

We support in reviewing business systems according to the 5 pillars of AWS Well-Architected Framework. By doing that, giving advice and solutions to help optimize the customer’s system with the lowest cost.

DEVELOPMENT SERVICE

Customers can customize services according to their needs with a flexible service package from VTI Cloud including project-based, laboratory, software leasing.

 

CLOUD MANAGED SERVICE

Our managed service will help you simplify & streamline your processes and manage exhaustive cloud solutions that address key components to fit well with your requirements and budgets.


WELL-ARCHITECTED REVIEW SERVICE

well-architected review vti cloud

We support in reviewing business systems according to the 5 pillars of AWS Well-Architected Framework. By doing that, giving advice and solutions to help optimize the customer’s system with the lowest cost.

DEVELOPMENT SERVICE

Customers can customize services according to their needs with a flexible service package from VTI Cloud including project-based, laboratory, software leasing.

 

CLOUD MANAGED SERVICE

Our managed service will help you simplify & streamline your processes and manage exhaustive cloud solutions that address key components to fit well with your requirements and budgets.

CLOUD MIGRATION SERVICE

migration service vti cloud

With numerous experiences helping enterprises migrating their workloads to AWS, VTI Cloud brings enterprises various business benefits like cost-saving, business agility, and retiring technical debt.


Camly Platform – How Camly leverage the Cloud for Business Innovation

Camly

About Camly.co

Camly Platform is a global real estate investment technology platform developed by IMMICA Corporation with over 11 years of experience in the field of real estate investment in the United States. Camly Platform provides a variety of investment forms and projects ranging from hotels to shopping centers, apartments, individual houses, etc. The company has six operations in major cities including Ho Chi Minh City, Hanoi, Da Nang, Tokyo- Japan, Los Angeles, and Huntington Beach – United States.

The Challenge

Over the past few years, the number of people who seek real estate investment in the U.S. has grown steadily. To capture this opportunity, CamLy Platform would need to implement a new system which is expected to handle 20,000 – 30,000 transactions per day, with roundly 10,000 active users and 100,000 registered users. Camly also identifies security to be their top priority. Additionally, the platform is anticipated to have some spikes during large scale-events or when new investment is opened.

The Solution

Camly Platform realizes they would need a cloud hosting solution where they can leverage managed services to meet their end-user demands while maintaining security, reliability, and operational excellence. They have decided to choose AWS because of its strengths in these aspects. VTI Cloud was quickly engaged with Camly Platform to work on this project. Both sides have been working closely to discuss the expectations and to gather system requirements. After thorough analyses and excellent support from Camly team, we have agreed on an AWS architecture with the following characteristics:

  • Ensuring encryption at rest and encryption on transit, also implementing WAF to prevent bad requests to the website, and DDOS.
  • Auto Scaling to make sure the system can maintain performance during demand spikes and decrease capacity during lulls to reduce costs.
  • Applying CICD model to automate the development and deployment process, eliminate the need to deploy manually.
  • Deploying the system to multi-Availability zone to prevent a single point of failure
  • Other AWS services: CloudFormation, CDN CloudFront, Elastic Beanstalk, Database Replica

The Benefits

The system successfully met the deadline of the project. During the first large scale-event, the system has been exceptionally reliable while maintaining a high-security level.

1. Security

Implemented data encryption

2. Reliability

With Auto Scaling and Application load balancer in place, the system met the demand of the platform users. In case the platform has a problem with the current region, they can easily use CloudFormation to run it in another region.

3. Operational Excellent

CICD: Save time to manually deploy code, reduce the need for maintenance

About VTI Cloud 

VTI Cloud is an Advanced Consulting Partner of AWS Vietnam with a team of over 50+ AWS certified solution engineers. With the desire to support customers in the journey of digital transformation and migration to the AWS cloud, VTI Cloud is proud to be a pioneer in consulting solutions, developing software, and deploying AWS infrastructure to customers in Vietnam and Japan.

Building safe, high-performance, flexible, and cost-effective architectures for customers is VTI Cloud’s leading mission in enterprise technology mission.

In addition, VTI Cloud supports building VIET-AWS community. This group is one of the fast-growing AWS User Groups and officially recognized by Amazon in the Asia Pacific (Vietnam) region.

VIET-AWS is a place to connect and exchange support between Solutions Architect, DevOps, SysOps, and budding students with cloud computing services of Amazon Web Services (AWS). Join VTI Cloud to join VIET-AWS: https://www.facebook.com/groups/vietawscommunity

WELL-ARCHITECTED REVIEW SERVICE

well-architected review vti cloud

We support in reviewing business systems according to the 5 pillars of AWS Well-Architected Framework. By doing that, giving advice and solutions to help optimize the customer’s system with the lowest cost.

DEVELOPMENT SERVICE

Customers can customize services according to their needs with a flexible service package from VTI Cloud including project-based, laboratory, software leasing.

 

CLOUD MANAGED SERVICE

Our managed service will help you simplify & streamline your processes and manage exhaustive cloud solutions that address key components to fit well with your requirements and budgets.