4 features for the Container-Aware Storage Layer

For many IT folks, containers are merely another flavor of virtualization, and they often make the mistake of assuming that storage for containers is no different from storage for virtual machines (VMs). But that is not the case. To understand the different requirements containers and VMs have for storage, one must fully comprehend the fundamental differences between these two architectures.

Virtualization refers to the act of creating a virtual (rather than actual) version of something, including virtual computer hardware platforms, operating systems, storage devices, and computer network resources. (Source: Wikipedia )

Virtual machines are neither nimble nor simple enough to support applications across large numbers of nodes. Hence the storage solutions that were built for virtual machines continue to be monolithic in nature, unable to support scale and lacking any understanding of the application running on top of them.

On the other hand, a container consists of an entire runtime environment: an application along with all its dependencies, libraries, and other binaries, and configuration files needed to run it, bundled into one package.

As a result, containers are much lighter than virtual machines and thus can be instantiated and scaled very quickly. One of the primary reasons for the popularity of container technology (e.g. Docker) is the ability to provision and scale applications across hundreds of nodes. This approach to storage solutions is very different from that of virtualization.

Containers require a distributed storage system that is natively elastic and can support creation and deletion of storage volumes at the rate of knots. Traditional storage systems are simply not designed to operate at the rate at which containers scale.

When designing the capabilities for the storage layer within the Robin Cloud Platform, we made sure to build in a number of container-aware critical features:

Application Data Placement

Distributed applications (such as NoSQL, Big Data etc.) require Rack-, Node-, Disk- and Subnet-level isolation of the data stored by each of the different application services. When running within containers, different partitions/shards of a NoSQL database shouldn’t coexist on the same disks or nodes. On the other hand, to minimize network load, some applications such as Hadoop/Hbase require collocation of data on the same node as compute. It is also best to run map-reduce jobs on the same nodes on which data resides.

Traditional storage products aren’t capable of understanding these application-level policies, hence such enforcement is not possible. Robin’s application-aware storage stack exposes several fine-grained controls that enforce these policies based on the type of application being deployed.

Application Lifecycle Management

Snapshots, clones and patching of multi-tiered and distributed applications require complex coordination between containers, network and storage stack. Just being consistent at the storage-volume level is not sufficient to guarantee application consistency. Traditional storage products are only capable of creating individual volume-level snapshots/clones. Robin’s storage layer is application aware and it completely understands an application’s topology. Hence, with just a click of a button one can create application-consistent snapshots and clones for any application (even those that don’t have built-in snapshotting and cloning capabilities). This Robin capability also extends to safe patching of an application and recovering from any failures via our unique “application time travel” feature.

Here is a demo of Cassandra snapshot clone and time travel.

QoS Guarantees

Robin Cloud Platform is container-aware and tailor-made for consolidation of disparate applications. Bringing performance predictability to a consolidated environment requires end-to-end enforcement of QoS policies. Most incumbent storage products were designed in the monolithic era, when application consolidation was not very common. Hence QoS guarantees are either not implemented or are very rudimentary and not capable of functioning in the container-era. Robin is the only product that can guarantee both MAX and MIN IOPS at the container-level and not just at the storage-volume level. Max IOPS cap prevents a single application from hogging resources and Min IOPS guarantee ensures predictable application performance.

As Robin storage is application aware it can distinguish IO traffic between original and cloned volumes and automatically enforce different priorities to each. Hence any application can be quickly thin-cloned without adversely affecting the performance of the original application.

Here is a demo of Robin QoS control.

Application-to-Spindle Insight 
Troubleshooting IO-related problems requires end-to-end insight of the IO pipeline — all the way from the application, where IO originates, to disks, where data resides. No storage product in the market today is capable of this insight because the products lack any presence on the compute side of the IO pipeline. Robin is the only infrastructure product that provides complete bi-directional insight. Users can map each IO all the way from the container running an application through the physical host on which the container is running, via the network ports used to reach the storage node and the disk on that node where data is persisted. In the reverse direction, each disk provides an up-to-date insight on which application has what type of data stored on that disk, and how much of it is currently in use. Together, both these insights help in quickly identifying IO hotspots and generating chargeback & compliance reports.

Acknowledgement: Thanks to Partha Seetala, CTO, Robin Systems, for his inputs on this blog post.

mm

Author Deba Chatterjee, Director Products

More posts by Deba Chatterjee, Director Products

Join the discussion 71 Comments

  • 99Jaqueline says:

    Hello admin, i must say you have high quality articles here.
    Your page should go viral. You need initial traffic boost
    only. How to get it? Search for: make your content go viral
    Wrastain’s tools

  • try this says:

    My family members always say that I am killing my time here at net,
    but I know I am getting know-how every day by reading thes good articles.

  • Hello.This post was really interesting, particularly because I was looking for thoughts on this issue last Saturday.

  • Wow! This could be one particular of the most useful blogs We have ever arrive across on this subject. Actually Great. I’m also a specialist in this topic therefore I can understand your effort.

  • Judi Online says:

    I truly appreciate this post. I have been looking everywhere for this! Thank goodness I found it on Bing. You’ve made my day! Thanks again!

  • I am continually looking online for tips that can help me. Thanks!

  • Judi Bola says:

    I want to show my love for your kind-heartedness giving support to those people that need guidance on your content. Your special dedication to getting the solution throughout has been really important and has all the time empowered folks just like me to achieve their desired goals. The helpful tips and hints denotes a lot a person like me and far more to my colleagues. With thanks; from all of us.

  • We are a gaggle of volunteers and starting a brand new scheme in our community. Your web site provided us with helpful info to work on. You have performed an impressive task and our whole neighborhood shall be grateful to you.

  • Hi, Neat post. There is a problem with your website in web explorer, might check this?K IE nonetheless is the marketplace chief and a huge section of other people will leave out your magnificent writing because of this problem.

  • It’s a pity you don’t have a donate button! I’d most certainly donate to this brilliant blog! I suppose for now i’ll settle for book-marking and adding your RSS feed to my Google account. I look forward to brand new updates and will talk about this website with my Facebook group. Chat soon!

  • I am only writing to make you understand of the impressive encounter my cousin’s princess had using yuor web blog. She came to find lots of things, including what it’s like to possess a wonderful giving mindset to let most people with no trouble thoroughly grasp some complicated topics. You really surpassed our own expectations. Thank you for giving the valuable, safe, edifying not to mention fun tips about the topic to Emily.

  • I discovered your weblog site on google and verify just a few of your early posts. Proceed to maintain up the excellent operate. I just further up your RSS feed to my MSN Information Reader. Seeking ahead to studying more from you in a while!…

  • I always was concerned in this topic and stock still am, regards for posting.

  • I?¦ve been exploring for a little bit for any high-quality articles or weblog posts on this kind of house . Exploring in Yahoo I ultimately stumbled upon this site. Reading this info So i?¦m glad to show that I’ve an incredibly good uncanny feeling I found out just what I needed. I such a lot without a doubt will make sure to do not omit this site and give it a look on a relentless basis.

  • Judi bola says:

    I like what you guys are up also. Such clever work and reporting! Carry on the excellent works guys I have incorporated you guys to my blogroll. I think it will improve the value of my website 🙂

  • Judi bola says:

    I’d must check with you here. Which is not something I often do! I get pleasure from reading a post that can make individuals think. Also, thanks for permitting me to comment!

  • Judi Online says:

    Very interesting points you have observed, thankyou for putting up. “My work is a game, a very serious game.” by M. C. Escher.

  • Judi casino says:

    You actually make it seem really easy with your presentation however I find this topic to be really one thing that I think I would by no means understand. It seems too complex and very wide for me. I am looking ahead for your next publish, I¦ll try to get the hang of it!

  • Bola Tangkas says:

    Thanks , I’ve just been searching for info about this subject for ages and yours is the best I have discovered so far. But, what about the conclusion? Are you sure about the source?

  • Real wonderful visual appeal on this web site, I’d rate it 10 10.

  • Seo Beratung says:

    Hello there! Do you use Twitter? I’d like to follow you if that would be okay. I’m undoubtedly enjoying your blog and look forward to new posts.

  • Very interesting info!Perfect just what I was searching for!

  • It’s the best time to make some plans for the future and it’s time to be happy. I have read this post and if I could I wish to suggest you some interesting things or tips. Maybe you could write next articles referring to this article. I want to read even more things about it!

  • Agen judi says:

    Lovely site! I am loving it!! Will come back again. I am taking your feeds also.

  • Judi bola says:

    There is evidently a bundle to realize about this. I consider you made various good points in features also.

  • Agen bola says:

    hey there and thanks in your info – I’ve certainly picked up something new from right here. I did alternatively expertise some technical points using this site, since I skilled to reload the site many times prior to I may get it to load correctly. I had been brooding about in case your web hosting is OK? No longer that I’m complaining, however sluggish loading instances times will very frequently have an effect on your placement in google and can injury your high quality ranking if advertising and ***********|advertising|advertising|advertising and *********** with Adwords. Well I’m adding this RSS to my e-mail and could look out for much extra of your respective exciting content. Make sure you replace this once more very soon..

  • Agen bola says:

    Loving the info on this site, you have done outstanding job on the articles.

  • Very interesting details you have noted, appreciate it for putting up.

  • Great article and straight to the point. I don’t know if this is really the best place to ask but do you folks have any ideea where to employ some professional writers? Thanks in advance 🙂

  • Thanks for some other excellent article. The place else could anyone get that type of information in such a perfect manner of writing? I’ve a presentation next week, and I’m at the search for such information.

  • Judi bola says:

    certainly like your web-site but you need to take a look at the spelling on quite a few of your posts. A number of them are rife with spelling issues and I in finding it very troublesome to inform the reality then again I will certainly come again again.

  • Judi bola says:

    My brother suggested I might like this web site. He used to be entirely right. This put up truly made my day. You cann’t imagine simply how much time I had spent for this info! Thanks!

  • Judi bola says:

    Hey would you mind letting me know which web host you’re utilizing? I’ve loaded your blog in 3 different internet browsers and I must say this blog loads a lot quicker then most. Can you suggest a good web hosting provider at a fair price? Kudos, I appreciate it!

  • Bola online says:

    I’ve been surfing on-line greater than three hours today, yet I by no means found any attention-grabbing article like yours. It is lovely worth sufficient for me. Personally, if all web owners and bloggers made just right content material as you probably did, the internet might be a lot more helpful than ever before. “Dreams have as much influence as actions.” by Stephane Mallarme.

  • I also think so , perfectly indited post! .

  • Agen bola says:

    Hi there! This post couldn’t be written any better! Reading through this post reminds me of my previous room mate! He always kept talking about this. I will forward this article to him. Pretty sure he will have a good read. Thank you for sharing!

  • It is really a nice and helpful piece of information. I am satisfied that you just shared this helpful info with us. Please stay us up to date like this. Thanks for sharing.

  • Very interesting points you have remarked, regards for posting. “The best time to do a thing is when it can be done.” by William Pickens.

  • Agen bola says:

    Outstanding post, you have pointed out some wonderful details , I as well think this s a very wonderful website.

  • Bola online says:

    I am not really good with English but I line up this very leisurely to interpret.

  • Merely wanna comment on few general things, The website style and design is perfect, the content material is really wonderful. “The way you treat yourself sets the standard for others.” by Sonya Friedman.

  • Agen judi says:

    I think you have remarked some very interesting points, thankyou for the post.

  • I have been exploring for a little bit for any high-quality articles or blog posts on this sort of area . Exploring in Yahoo I finally stumbled upon this site. Studying this info So i am satisfied to express that I’ve a very just right uncanny feeling I discovered just what I needed. I so much definitely will make sure to do not disregard this site and provides it a glance regularly.

  • Nice post. I was checking continuously this weblog and I’m impressed! Very helpful information specifically the ultimate part 🙂 I maintain such information much. I used to be seeking this particular information for a very long time. Thank you and good luck.

  • Judi bola says:

    I got what you intend, regards for putting up.Woh I am delighted to find this website through google.

  • waec physics says:

    I think other website proprietors should take this web site as an model, very clean and fantastic user genial layout.

  • Bola online says:

    I am curious to find out what blog platform you’re using? I’m having some minor security issues with my latest website and I’d like to find something more secure. Do you have any recommendations?

  • Agen judi says:

    Hello. remarkable job. I did not anticipate this. This is a remarkable story. Thanks!

  • you are actually a just right webmaster. The website loading pace is amazing. It seems that you are doing any distinctive trick. Moreover, The contents are masterwork. you have performed a excellent job in this matter!

  • Howdy very cool web site!! Guy .. Beautiful .. Wonderful .. I will bookmark your site and take the feeds additionallyKI am glad to find a lot of useful information here in the post, we’d like develop extra strategies in this regard, thanks for sharing. . . . . .

  • I have not checked in here for a while since I thought it was getting boring, but the last several posts are good quality so I guess I’ll add you back to my daily bloglist. You deserve it my friend 🙂

  • Lovely just what I was looking for.Thanks to the author for taking his time on this one.

  • I couldn’t resist commenting

  • Hello. impressive job. I did not anticipate this. This is a excellent story. Thanks!

  • Nice post. I learn something more challenging on different blogs everyday. It will always be stimulating to read content from other writers and practice a little something from their store. I’d prefer to use some with the content on my blog whether you don’t mind. Natually I’ll give you a link on your web blog. Thanks for sharing.

  • Judi bola says:

    You got a very fantastic website, Gladiola I discovered it through yahoo.

  • I think other website owners should take this site as an example , very clean and good user pleasant design and style.

  • Today, while I was at work, my sister stole my iPad and tested to see if it can survive a forty foot drop, just so she can be a youtube sensation. My apple ipad is now destroyed and she has 83 views. I know this is completely off topic but I had to share it with someone!

  • Exactly what I was looking for, thankyou for posting.

  • Macbook Pro says:

    I really appreciate this post. I have been looking everywhere for this! Thank goodness I found it on Bing. You’ve made my day! Thank you again

  • Wow! This could be one particular of the most beneficial blogs We have ever arrive across on this subject. Actually Great. I’m also a specialist in this topic therefore I can understand your effort.

  • F*ckin’ awesome things here. I am very happy to look your article. Thank you so much and i’m taking a look forward to contact you. Will you kindly drop me a mail?

  • Macbook Pro says:

    I really like your writing style, great information, thanks for posting : D.

  • Very nice article and straight to the point. I don’t know if this is really the best place to ask but do you guys have any thoughts on where to hire some professional writers? Thx 🙂

  • Great V I should definitely pronounce, impressed with your website. I had no trouble navigating through all the tabs as well as related information ended up being truly simple to do to access. I recently found what I hoped for before you know it at all. Reasonably unusual. Is likely to appreciate it for those who add forums or something, website theme . a tones way for your customer to communicate. Nice task..

  • Hi there! This post couldn’t be written any better! Reading through this post reminds me of my previous room mate! He always kept talking about this. I will forward this article to him. Pretty sure he will have a good read. Thank you for sharing!

  • I haven’t checked in here for some time because I thought it was getting boring, but the last few posts are great quality so I guess I’ll add you back to my everyday bloglist. You deserve it my friend 🙂

  • This website online is mostly a walk-through for all the data you wished about this and didn’t know who to ask. Glimpse here, and you’ll definitely discover it.

  • I wish to show appreciation to the writer for bailing me out of this incident. Right after looking out throughout the internet and seeing ideas that were not powerful, I believed my entire life was gone. Living minus the solutions to the difficulties you have sorted out by way of your good guideline is a critical case, and those that might have in a negative way affected my career if I had not noticed your blog. The skills and kindness in playing with almost everything was priceless. I’m not sure what I would’ve done if I hadn’t encountered such a stuff like this. I can also at this moment relish my future. Thanks a lot very much for the high quality and result oriented help. I won’t be reluctant to endorse the blog to any person who needs tips about this issue.

  • naturally like your website but you have to take a look at the spelling on several of your posts. A number of them are rife with spelling problems and I in finding it very troublesome to tell the reality on the other hand I?¦ll certainly come back again.

  • Outstanding post, I conceive blog owners should larn a lot from this blog its really user pleasant.

Leave a Reply