I am not a tech guy but the concept of Ultra Low Latency Designs and Architectures have really fascinated me over a couple of years. The credit goes to this genius consultant who does consulting for companies like Google, Intel, Samsung, JP Morgan, Morgan Stanley to name a few. With my research on it and with some seminar’s which I attended by him gave me more insights. Although the technical aspects were going completely above my head I could relate to it with its use cases.
Of-course a senior techie with knowledge in Java on getting more insights about this would definitely be amazed by its capabilities. In fact, over the last one year, we have been seeing a tremendous response from various companies by senior technology officers on this concept. One of my recent interaction was with a senior professional in Astro Physics working at an aviation company who was stunned by its capabilities as his major problem was about the matrix and equations. Well as per my understanding Ultra Low Latency Design and Architecture is not a technology but a concept which is very effective in applications which need to deal with high volumes of data and for having high-performance applications. It can be applicable to BFSI, E-commerce, Internet, Logistics, Aviation, Airlines, Telecom and Technology companies. It can increase the speed and performance of the application immensely giving the company more opportunities in creating a lot more revenue, better quality, better user experience and have a competitive edge.
Ultra Low Latency Design and Architecture Abstract:
Traditional models of concurrent programming have been around for some time. They work well and have matured quite a bit over the last couple of years. However, every once in a while there is low latency and high throughput requirements that cannot be met by traditional models of concurrency and application design. How about handling 800-900 million operations/second per core of a system. When designing such systems one has to throw away the traditional models of application design and think different. It teaches about some of the approaches that can make this possible. This approach is hardware friendly and a re-look at data from a hardware perspective. It requires logical understanding of how modern hardware works. It also requires the knowledge of tools that can help track down a particular stall and possibly the reason behind it. This may provide pointers for a redesign if required.
It is about an architecture developed in Java which is Hardware friendly. It is also about very specialized data structures that fully exploits the underlying architecture of the processor, cache and memory.
I have listed a couple of its applications in some of the industries below:
Low latency is a very important topic in capital markets, where the proliferation of algorithmic trading or activity requires firms to react to market events faster than the competition to increase profitability of trades. A millisecond decrease in a trade delay may boost a high-speed firm's earnings by about $100 million per year and also helps a firm to gain a great competitive advantage.
In summary, statistics show that if your store is making $100,000 per day, you could lose up to $2.5 million in sales each year due to a 1-second delay in loading times. Amazon has even said a 100-millisecond improvement in page speed translates to a 1% increase in revenue. With those numbers, it should be very clear why low latency is especially critical for a growing eCommerce site dealing with high volumes of data. It’s about making the user experience the best and maximizing your revenue.
With a high number of search queries and activities on the application, the application needs to be super-fast with a low turn-around time to give the customer what he needs. This can be achieved with Ultra-Low Latency Designs and Architectures.
My quest has been on educating companies on early adoption of this concept to make the best of its capabilities. We believe the companies which adopt them can stay ahead in time and solve the major problems of Big Data, performance and user experience combined.