Explore insights on real-time edge computing, AI, and cloud solutions. Learn how our technology optimizes performance across industries.

Blog

2022 has been an eventful and exciting year for Macrometa. From product launches to new strategic partnerships, SOC 2 compliance, and a virtual Developer Week, we’ve had a lot of achievements to celebrate with our customers.

In this blog post, I’ll outline Macrometa’s 2022 year in review, our many successes, our plans for 2023, and our ambitious vision for the future to help our customers move their business forward.

The year 2022 has been an excellent success for Macrometa and its customers. We developed our ground-breaking edge computing platform, which has enabled us to provide powerful, secure, and reliable data solutions to our customers. Additionally, we released our enterprise-grade 

 solutions, which are designed to help businesses better manage their data and quickly gain insights. Here are some highlights:

One of the proudest moments for Macrometa from 2022 was achieving the SOC 2 certification.

In a fully-distributed world that processes information milliseconds, we must instill confidence in our data policies and security. This certification is a huge milestone for Macrometa and the culmination of months of hard work and dedication toward the security of our platform.

Learn more about how we're committed to keeping data safe in the SOC 2 

announcement from Macrometa CISO Eddie Garcia.

Current 2022, the next-generation Kafka Summit

 in Austin, Texas, October 4-5. This was the first-ever data streaming industry event, and we were grateful to have met real-time data experts worldwide.

Akamai and Macrometa partner to create an Edge Cloud Super Platform for Enterprise Developers. Akamai cloud computing based on Linode and EdgeWorkers edge computing technology combined with Macrometa's Global Data Network (GDN) will help enterprise developers build, deploy, and run global apps and APIs seamlessly across edge and cloud.

DevCycle partnered with Macrometa to launch the the world's first and fastest Feature-Flag-as-a-Service (all from the Edge). 

 about why they chose Macrometa and how they built an ultra-low-latency global feature flags solution using Macrometa.

Hosted a virtual Developer Week and released demo videos

Macrometa hosted a week-long Developer Week from November 7th - November 11th, 2022, where developers could see real-life use cases in action, build a streaming app in minutes, and explore the 2023 roadmap.

This week-long online virtual event focused on enterprise developers interested in building the next generation of globally-distributed, real-time applications and APIs. It features tutorials and guides from partners like Akamai and Dish Networks and customers AppSecEngineer, and DevCycle, to name a few. During Developer Week, Macrometa hosted technical content workshops and demos for real-time apps and APIs for web, mobile, IoT in SaaS, Web Services, developer tools, multiplayer gaming, video streaming, e-commerce, manufacturing, and more.

Watch all the demo videos and developer week content

We launched a public Slack Community for our users to engage with each other and with product experts at Macrometa. We’re hoping it will become a place where our community helps each other solve problems and share best practices.

Throughout 2022, we’ve been focusing on creating content to help our prospects, developers, and customers learn more about Macrometa and its solutions.

Some of the webinars that we launched in 2022:

Complex Event Processing: What’s After Apache Spark and Apache Flink

 we compare Macrometa's CEP and streaming analytics platforms like Spark and Flink to help you determine which solution best matches your use case. Learn about the difference between streaming analytics and CEP and how to get the most value from your data.

The Edge of Retail: Enabling Real-time Inventory Management

 to learn more about how real-time inventory management can boost profits and improve customer experiences. The experts at Macrometa explain how edge computing brings the power of real-time visibility to retail operations. 

Watch any of these webinars on demand at your convenience and reach out if you have any questions.

Unraveled Macrometa’s New UI And Design Process

Macrometa Head of Design - Dustin Larimer shares a peek into his team’s effort to craft a new visual aesthetic, brand system, and design system. Read more about the new UI 

At Macrometa, our vision is to be a leader in GDN & edge computing, and data management solutions. Our goal for 2023 is to continue to drive innovation in data management solutions and to provide our customers with access to our powerful and reliable data solutions. We also want to continue expanding our strategic partnerships, exploring new opportunities, and building on our existing partnerships.

We released our product roadmap highlights during Developer Week. 

 as our Product team gives a preview of some of the exciting things to come in 2023. 

We are confident that 2023 will be an exciting and successful year for Macrometa. We look forward to continuing to provide our customers with the utmost powerful solutions.

 to get started. If you're interested in testing new features, reach out to me at justin@macrometa.com.

Inside Macrometa 2022, And A Blazing Start To An Excitingly Futuristic 2023!

Everyone is familiar with major cloud providers’ regions and what happens to businesses when a main location goes offline or has poor performance. It can have a lasting economic impact across the country or multiple countries. Once a customer can’t order food service, find a ride, get directions, or make a purchase, they may choose not to use your business again. We live in a real-time world where the demand is no longer in minutes or seconds, but in the milliseconds. Points of access have become more critical - as we are soon challenged with managing 

 is built upon Points of Presence (PoPs) - data centers located in strategic geographical locations around the globe. These data centers serve as a point of access to enable organizations to leverage distributed applications and services with incredibly low latency. Let’s walk through more details about PoPs and Macrometa’s GDN. 

 is a physical location, or an artificial demarcation point, that connects sites or communication 

. To access the internet, a PoP communicates with the network access point which is the point where networks exchange access requests.

When a user requests access, that request goes to the nearest PoP to the user. So if you are in Atlanta, the Atlanta PoP would respond to that request. The access request reaches internet exchange points where the information is then exchanged and the user gets access to peer between networks.

Generally speaking, the larger the PoP network, the less latency there is, resulting in a better user experience. If there is a data center connection failure at the nearest PoP, the request can be rerouted to the next closest PoP with no service interruption. The latency difference may be barely noticeable if the next closest PoP is still in a similar region.

The Macrometa GDN is available in over 175 cities - or PoPs around the world. Macrometa puts data into action and offers 

 that can deliver real-time and event-driven apps and APIs into more than 2B users and 10B devices in 50ms. Our global PoPs can also act as a 

 on top of five different service providers that include cloud providers, telecom providers, and CDNs. Our service provider 

 include Akamai (who acquired our partner Linode), Cox Edge, AWS, and Google Cloud. Because the GDN is on top of routes and capacity provided by transfer providers who have different economics and pricing than typical cloud providers, it can result in significantly less costs than the cloud. Plus, the diversity means you don’t have to worry about outages with one provider - or in one location - affecting your bottom-line. 

More control over data location, compliance, and costs

With Macrometa, your solution can include fabrics for multiple regions in the GDN. The 

 feature allows your organization to use a subset of regions, all based on your own criteria and not pre-generated (such as US, Europe, or Asia). GeoFabrics helps organizations comply with local data regulations (such as GDPR) and reduce read/write costs associated with global replication. GeoFabrics offers more options when data should be stored/accessed - with a simple on/off switch. With GeoFabrics, organizations can just select the regions they need and Macrometa will handle all of the operations.

The flexibility to choose your cloud environment

With Macrometa, your organization can choose our cloud with the GDN PoPs, or choose a multi-cloud or hybrid cloud where you're on-prem and in the cloud. Or Macrometa can be deployed in a virtual private cloud or in your organization's on-prem data centers - to leverage your existing investments or adhere to company or local security policies. If you are currently using a specialized cloud provider, have contractual obligations with an existing provider, or would like a service outside of our 175+ PoPs, you can work with Macrometa to include them in your network.

 can meet modern performance demands in a geographically distributed system. If you want to see Macrometa in action, request a

Driving Low Latency With Global PoPs

Games need the right platform and protocol for fast reaction times. The edge offers smoother gameplay and less lag. It can also simplify management and reduce costs compared to the cloud or servers.

Let’s run through the advantages of the edge and compare TCP and UDP protocols. Then we will go over the Macrometa for Gaming solution and how you can get started.

 or data centers for scale and management. Traffic delays with the cloud or faraway servers can degrade cross-play or cross-save gaming experiences. At the 

, you can store and process data close to your players - resulting in better response times. Common cloud providers can be expensive as your data volumes increase. Backend servers need time and resources for set-up, maintenance, and updates.

TCP connects players around the world. It is a reliable, connection-oriented protocol that provides error checking and flow control. Many online games use TCP for network communication and to keep data secure. Real-time strategy, multiplayer online role-playing, chess, and puzzle video games are often TCP-based. Some multiplayer first person shooter games and 

The main difference between TCP and UDP is that TCP is connection-oriented while UDP is not. TCP requires a three-way handshake to establish a connection before data can be sent, and UDP does not have this requirement.

UDP is popular due to its low overhead and its ability to send data quickly and efficiently. It is often used for first-person shooters, racing and sports titles, and massively multiplayer online role-playing games when faster response times are required. Not all games need the same response times and TCP is still a good option in many situations.

With over 175 points of presence (PoPs), Macrometa enables multi-region gaming efficiencies. Data is automatically replicated across the Global Data Network (GDN). API requests are routed to the nearest available location. Updates at any location propagate across the network and bring all nodes to parity within milliseconds. Macrometa’s geo-distributed, real-time data layer is available within 50ms of 80% of the global population. This allows you to 

You can maintain a persistent state using different types of data within the Macrometa 

 and event & log capture to streamline development. The GDN also provides an 

 layer that’s deeply integrated directly with the data layer itself - that brings compute to where the data is originating, or the data is being consumed.

By using a single platform with analytics, you can have a clear view of all gaming activities. Spot early trends and recognize patterns to create business opportunities or prevent threats. For example, you can detect lag switches, or prevent bad actors from stealing gamers' information. Use 

 to check game health and gamer activities. Create new revenue programs and personalize gamers’ experience with real-time leaderboards and incentives.

Currently, Macrometa supports TCP for dynamic data. If UDP support is needed, a microservice can be created that connects to the Macrometa GDN.

Check out the tutorials, QuickStarts, and 

 to quickly get started with Macrometa. I mean you can actually build a streaming app in 10 mins or less! Start by requesting 

How to Create Better Gaming Experiences on the Edge

A fascinating fact about the octopus - they create these elaborate, ocean floor dens with shells and shiny treasures they find along the way. All of these pieces – bottle caps, coconuts, shells, rocks, coral, pieces of shipwrecks – are collectively known as an Octopus’s Garden. I believe some young lads from Liverpool might have talked about it once.

The interesting part is that although these little garden cities sound like a magical Octlantis, Octopus are a hell of a lot more than interior decorators. They use the shells as tools for gathering food or as a door to thwart intruders, they use them as support structures to give their dens strength and rigidity, and they’re used as landmarks - all kinds of utilitarian brilliance out of different pieces.

In a previous post, we touched a little on the similarities between the 

 For one, there’s no single point of failure. The octopus in its profound design has multiple hearts, a brain in each arm that acts independent of the others. It’s a beautifully crafted, natural redundancy that we felt drawn to. Macrometa, after all, has a decentralized architecture that makes us, like this humble cephalopod, both highly fault tolerant and resilient. 

It also reminded me of the ecosystem we’re building with our partnership community. The way Macrometa plays well with other tools. From an architectural standpoint, I think about the Global Data Mesh and the ability to filter in data from all of these little pieces everywhere. Every data source, every event, every PoP, every 

 - are all important pieces of the octopus garden. This foundation provides tools for developers to remedy their previously unsolvable problems with low latency at the edge.

[This isn’t an endorsement for intelligent design, not in the slightest, but isn’t it amazing how these parallels are all designed so intelligently]

 is a full-stack edge platform for building and running applications at the Edge. The GDN “garden” consists of a Global Data Mesh, Edge Compute, and Data Protection.

Global Data Mesh: Real-time, geo-distributed storage layer

Historically, database management and storage has been the bane of IT. As the ocean of data ebbs and flows in all directions, developers and enterprises and everyone that relies on data for decisions need a simplified way to quickly address different types of data. The 

 has all the benefits of a NoSQL database with KV, doc, and graph stores – but the garden is even richer than that. 

Edge Compute: Run real-time apps close to your customers

Macrometa’s Edge Compute puts data into action and delivers real-time and event-driven apps and data globally in <10ms.* The shiniest tools in this garden are 

. Query Workers let developers create simple REST APIs on top of the data mesh. Stream Workers enables Complex Event Processing functions and Stream Processing workloads - in minutes instead of days or months.

Customers tell us that the combination of tables and streams integrated within Macrometa and the ability to use Stream Workers to process data live is “the Holy Grail” for app development. 

Organizations need to comply with regulatory and legal compliance standards. Macrometa’s Data Protection supports geo-pinning or geo-fencing to address data sovereignty use cases. Developers and operations can easily set up 

 for regional and global data, and adjust locations with just a toggle. 

 and offers user, token-based, and API keys 

. It encompasses privacy, security, governance – the healthy tenets of a “security garden” I suppose. Hmm, maybe we should’ve called it a security garden. 🤔

 that create the gardens are considered “ecosystem engineers.” They’re called this because they create and transform their environments, improving resource availability for everyone in the community. At Macrometa we team up with partners to give our developers flexibility and speed. The Global Data Mesh connects data so that it can be stored, accessed, and processed at lightning speed, regardless of where it lives. We chose a mascot that was already doing the things we aspired to do.

Our goal is to give developers the freedom to build and run applications anywhere. We can work within their existing platforms like 

, and even get their applications over that “last mile” with partners like 

 with just a simple service API. Once you’ve built an impossible app, do Feature Flags in real-time thanks to our recent 

 partnership launching the world’s first and fastest Feature-Flag-as-a-service (from the Edge). 

As a company, we’ve prided ourselves on working well with others, and in the process we’ve created many gardens. The point is that they make things stronger, they add resilience, and we continue to explore new ways of seamlessly integrating the “shells” and “shiny objects” that make up the development landscape.

Create your own octopus garden and build the next impossible app. Request a 

We look forward to making some exciting announcements in the next few weeks and would love for you to build with us.

A Data Mesh Is The New Octopus Garden

Originally published 11/1/2022 by Corey Quinn, Chief Cloud Economist at The Duckbill Group, as a Screaming in the Cloud podcast, episode 405, “

Computing on the Edge with Macrometa’s Chetan Venkatesh.

Chetan Venkatesh, Macrometa CEO and Co-founder chatted with Corey Quinn to define the edge and how the edge is “new kind of distributed cloud.” Developers can build apps in a distributed way with Macrometa’s Global Data Network that you “just can’t do in the cloud anymore.” In his chat with Corey, Chetan runs through the need for a consistent data view, the layers of the Macrometa Global Data Network, typical use cases, and how Macrometa is helping developers lower their carbon footprint with more efficient coding and tools.

The term “edge” has been applied across many aspects of IT, especially around 5G technologies. The recent hype is not surprising, when you consider that edge-related annual revenue has been predicted to grow to nearly $274B in 2025 by 

. During the podcast, Chetan clarifies the term edge with a specific definition and indicates there are three different types.

Chetan indicated the edge is “very different from the cloud” when you consider “...that the cloud is defined by centralization, i.e., you’ve got a giant hyperscale data center somewhere far, far away...where you run things at scale and somebody else manages them for you.”

In contrast, “the edge is actually defined by location” and here are the three types per Chetan. And these three types “are now becoming important as a place for you to build and run enterprise apps.”

The first is the Content Delivery Network (CDN) edge and Chetan describes how this is historically “where we’ve been trying to make things faster with the internet and make the internet scale.” Akamai created the 

 “that allowed the web to scale….that’s the first location that defines the edge…where a lot of the peering happens between different network providers and the on-ramp around the cloud happens.” Akamai and Macrometa are working closely together to 

 and Akamai made quite a few appearances during our recent 

“The second edge is the telecom edge. That’s actually right next to you…because every time you do something on your computer, it goes through that telecom layer. And now we have the ability to actually run web services, applications, data, directly from that telecom layer, “ Chetan relayed to Corey. Macrometa works closely with telecom providers like 

The third edge is something that is ready and available at your fingertips and you take it everywhere -your mobile device! Per Chetan, “it’s your internet gateway” and “where you have some compute power, but it’s very restricted and it only deals with things that are interesting or important to you as a person.”

Consistent view of data anywhere in the world

 was originally designed for economies of scale by having data in a centralized location and to make it easy to add or change technologies. However, the cloud does present some challenges that Chetan talks about like how do you “take data and chop it into 50 copies and keep it in 50 different places on Earth.. then keep all those copies in sync?.. So you start to deal with some very basic computer science problems like distributed state and how do you build applications that have a consistent view of that distributed state?..”

 for this issue has to cover three areas: “a way for programmers to do this in a way that doesn’t blow their heads with complexity, a way to do this cheaply and effectively enough where you can build real-world applications that serve billions of users concurrently at a cost point that actually is economical and makes sense, and third, a way to do this with adequate levels of performance where you don’t die waiting for the spinning wheel on your screen to go away.”

Introduction to the Macrometa Global Data Network

 is based on cutting edge computer science incorporating new ideas and research in the areas of messaging, event processing, data consistency, and replication. The Macrometa GDN has 

: a Global Data Mesh that is a real-time, geo-distributed storage layer, an Edge Compute layer to process data to run real-time apps close to your customers, and a Data Protection layer to help organizations comply with regulatory and legal standards.

 has all the benefits of a NoSQL database with KV, doc, and graph stores - plus Macrometa Streams with Pub/Sub and messaging queues. What separates Macrometa from other data storage solutions is that it brings compute closer to people and where data is generated, regardless of where that is. 

Organizations need a consistent view of data, even if multiple copies are sitting all around the world. Say you are a large retail distribution company and folks are ordering from your site, you need 

Chetan explains to Corey that programmers need to be able to operate, modify, and replicate that data with consistency guarantees and high levels of performance. Edge computing and the Macrometa platform “literally puts data and applications within 50 milliseconds of 90% of humans and devices on Earth.” This may seem like a new paradigm, but Chetan indicates it is more of a continuum. The Macrometa platform “feels very much like 

Data comes in different forms and developers don’t have the time to reformat data. Macrometa “provides continuity by looking like a key-value store like Redis” and has “a streaming graph engine built into it that kind of looks and behaves like a graph database, like Neo4j.” Macrometa can distribute and sync data across hundreds of locations but “it looks like a conventional NoSQL 

Plus, Macrometa provides an ACID-like consistency and can support changes (like read and update requests) when you’ve apps running in 100s of locations and each of those places is modifying the same record.

Chetan explains a typical example of organizations with multiple locations. “We have the ability to connect data sources across all kinds of boundaries; you’ve got some data in Germany and you’ve got some data in New York. How do you put these things together and get them streaming so that you can start to do interesting things with correlating this data?”

Another example is when organizations need to collaborate with supply chain or other partners in real-time to address a supply shortage or distribution issue. With the Global Data Mesh you can, “very quickly connect data wherever it might be in legacy systems, in flat files, in streaming databases, in data warehouses,” per Chetan. Macrometa has “500-plus types of connectors.”

But it is not only about getting the data 

 - it is making the data fungible with APIs. “Because the minute you put an API on it and it’s become fungible now that data has actually got a lot of value. And so the data mesh is a way to very quickly connect things up and put an API on it. And that API can now be consumed by front-ends, it can be consumed by other microservices, things like that,” Chetan describes the instant benefits of building APIs on top of the Global Data Mesh.

As Chetan relays to Corey, the GDN also “provides an [Edge] Compute layer that’s deeply integrated directly with the data layer itself. So think of it as Lambdas running stored procedures inside the database… We’ve built a very, very specialized compute engine that exposes containers in functions as stored procedures directly on the database.” You can easily build apps in Python, Go, or the 

 that lets developers create simple REST APIs on top of the data mesh and 

 enables Complex Event Processing (CEP) functions and Stream Processing workloads. 

Macrometa has a compute runtime “that is Docker compatible, so it runs containers,.. it’s Lambda-like,.. so it runs functions.” You can build stateful microservices that can interact with data locally and “then schedule them along with the data on our network of 175 regions.” Chetan goes on to provide some examples of building distributed apps on the GDN.

With a cloud provider, your microservices back-end for a banking, HR 

 app may run in a specific region or two like us-east-1 and Virginia. In the Macrometa GDN, it will potentially run in 15, 18, or even 25 cities - where your end-users are located. If you are ingesting data from an electricity grid in 15-20 cities for 

, you can do all of that locally with Macrometa.

“So that’s what the edge functions does, it flips the cloud model around because instead of sending data to where the compute is in the cloud, you’re actually bringing compute to where the data is originating, or the data is being consumed, such as through a mobile app,” Chetan explains the key benefits of Macrometa vs a typical cloud model.

 layer lets you have fine-grained control of your data. Chetan describes the region-specific benefits of this layer to Corey. With Macrometa, “you can build an app once, and we’ll provide all the necessary localization for region processing with the tokenization of data so you can exfiltrate data without violating potentially 

Macrometa helps organizations comply with different privacy and regulatory frameworks and helps keep data secure in each region with geo-pinning or geo-fencing. Developers and operations can easily set up 

 for regional and global data, and adjust locations with just a toggle. Macrometa is 

Of course, almost all customers have an infrastructure already in place and the question may be how to begin with Macrometa. With Macrometa, you can simply plug a set of serverless 

Chetan explained how customers can get started, depending on the application, “Some of your applications work great in the cloud. Maybe there are just parts of that app that should be on our edge. And that’s usually where most customers start; they take a single web service or two that’s not doing so great in the cloud because it’s too far away; it has data sensitivity, location sensitivity, time sensitivity, and so they use us as a way to just deal with that on the edge.

And there are other applications where it’s completely what I call edge native, i.e., no dependency on the cloud and runs completely distributed across our 

 and consumes primarily the edge’s infrastructure, and just maybe send some data back on the cloud for long-term storage or long-term analytics.”

Chetan provides further details and an example here, “The edge is a speciation….of the cloud, into a fast tier where interactions happen, i.e, the edge.” This may be credit card companies checking for fraud patterns, to shut down transactions before they lose money, or other time-sensitive transactions. Chetan describes the Macrometa GDN as a “system of interaction, not a system of record.” The three layers of the GDN - the Global Data Mesh, Edge Compute and Data Protection - “are the way that our 

 are shaped to help our enterprise customers solve these problems,” per Chetan.

One way to understand the full capabilities across Macrometa is to “imagine ten years from now what DynamoDB and global tables with a really fast Lambda and Kinesis with actual 

 built directly into Kinesis might be like. That’s Macrometa today, available in 175 cities,” Chetan elaborates on Macrometa functionality.

 (PoPs) around the world. With cloud computing, latency and cost are issues, as data has to travel to and from a centralized location and the cost of exporting data can be high. Macrometa, in contrast, is set up to reach 2B users and 10B devices in 50ms, at up to 70% less than typical cloud costs.*

Chetan describes the unique way the PoPs network was created,“What we have built is a network that is completely independent of the cloud providers. We’re built on top of five different service providers. Some of them are cloud providers, some of them are telecom providers, some of them are CDNs.”

“And so we’re building our Global Data Network on top of routes and capacity provided by transfer providers who have different economics than the cloud providers do. So our cost for egress falls somewhere between two and five cents, for example, depending on which edge locations, which countries, and things that you’re going to use over there. We've got a pretty generous egress fee where, you know, for certain thresholds, there’s no egress charge at all,” Chetan explains to Corey as he questions him about egress charges.

 based on the distribution, scale, and support you need for your organization.

Democratizing latency with the Macrometa GDN

“We stop this whole ping-pong effect of data going around and help create deterministic guarantees around 

, around location, around performance,” Chetan provides more detail about latency. ”We’re trying to democratize latency and these types of problems in a way that programmers shouldn’t have to worry about all this stuff. You write your code, you push publish, it runs on a network, and it all gets there with a guarantee that 95% of all your requests will happen within 50 milliseconds round-trip time, from any device, in these population centers around the world.”

An Edge as A Service Platform delivering value

The Macrometa platform reduces complexity and really accelerates developer velocity. Chetan walks Corey through different use cases. Macrometa can support the targeted and personalized approach required by today’s subscription economy with low latency, in-region processing, while helping you comply with data regulation laws. For example, one of our customers “is a SaaS company in marketing uses Macrometa to inject offers while people are on their website browsing. Literally, you hit their website, you do a few things, and then boom, there’s a customized offer for them,” as Chetan describes to Corey.

Chetan provides another use case example where low latency is required to deliver real-time personalization ads and offers, “in 

 you’re making your minimum payments on your credit card, but you have a good payment history and you’ve got a decent credit score, well, let’s give you an offer to give you a short-term loan. So those types of new applications, you know, are really at this intersection where you need low latency, you need in-region processing, and you also need to comply with data regulation.”

Lowering your carbon footprint by being conscious of code efficiency

Chetan talks about ways that Macrometa “cares a lot about helping make developers more aware of what kind of carbon footprint their code tangibly has on the environment.” Macrometa has “started a foundation that we call the Carbon Conscious Computing Consortium—the four C’s. We’re going to announce that publicly next year, we’re going to invite folks to come and join us and be a part of it.”

Macrometa is also “building a completely open-source, carbon-conscious computing platform that is built on real data that we’re collecting about, to start with, how Macrometa’s platform emits carbon in response to different types of things you build on it,” according to Chetan. “So for example, you wrote a query that hits our database and queries, maybe 20 billion objects inside of our database. It’ll tell you exactly how many micrograms or how many milligrams of carbon—it’s an estimate,” per Chetan.

The cost of carbon will vary in different places and with different technologies but the estimate will be a great starting point. Developers can decide when to throttle down and they can know how much micrograms of carbon a specific query will emit. Per Chetan, “there’s a cost to run code - whether it is a function, container, a query, every operation has a carbon cost. And we’re on a mission to measure that and provide accurate tooling directly in our platform… ” Stay tuned and be sure to follow us on 

 to get the most up-to-date information on our Carbon Conscious Computing Consortium. 

Are you ready to dive deeper about the edge and Macrometa? Your organization may be considering the edge because they are challenged by latency and higher costs in cloud applications and workloads. Check out this 

 written by Durga Gokina, CTO and Co-founder of Macrometa that discusses how to reduce write costs and the importance of data models and platforms. The paper explains how applying multiple data models on a single copy of data reduces storage and processing costs and how Macrometa's coordination-free architecture works for data-in-motion and data-at-rest use cases.

You can also get started with Macrometa in minutes with so many many tutorials, QuickStarts, and easy-to-follow example 

. I mean you can actually build a streaming app in 10 mins or less! Start by requesting a 

Computing On The Edge: Screaming In The Cloud Podcast Recap

We're excited to share with you that we have launched a public Slack for the Macrometa Community. You can sign up for the Slack 

The Macrometa Community Slack is not replacing our existing world-class technical support. Any urgent issues should still be directed to our support team, and we can help you out.

The Community Slack is for Macrometa users to engage with each other and with some of us at Macrometa. I’m hoping it will come to be a place where our community helps each other solve problems and share best practices.

Of course, any actual problems with the product are for Macrometa to fix, but sometimes you just “get stuck” trying to implement something and benefit from a fresh perspective. In the Macrometa community Slack, we hope you will find that fresh perspective. It’s also a place for the Macrometa community to just “hang out” and get to know each other. I hope to see you there!

See you all soon in the Macrometa Community Slack :)

Macrometa Launches A Public Slack For The Developer Community

Excerpts from this article were originally published in the Datanami article “

Has Macrometa Cracked the Code for Global, Real-Time Data

There is an old saying that time is money. Data has a 

time, location, concurrency, and actuation value

. However, trying to combine real-time and historical data often ends in complex or expensive solutions that may not be able to keep up with the required low 

 demands. In this blog, we will explore the recent 

 about how Macrometa’s architecture and features deliver real-time data value. The article highlights how Macrometa offers a Global Data Mesh, provides a unique use of conflict-free replicated data types (CRDT)s, and integrates the Global Data Mesh with Edge Compute and Data Protection in a “three-layer cake” within the Global Data Network (GDN).

Macrometa CEO Chetan Venkatesh kicks off talking to Datanami about a typical customer example, Cox Communications, and “how the amount of data they were sending in, the scale at which they had to build and integrate these systems made it too complex and slow” with a cloud provider. Once Cox Communications engaged Macrometa, they were able to “reduce costs by 90% and have a picture of reality within the hundreds of milliseconds of latency” vs minutes to hours delay. Let’s run through the Macrometa components that provide these real-time benefits.

A solution for big and fast data - Global Data Mesh

The issue today is that data has to make the roundtrip to a centralized data center - whether on premises or in the cloud - and this is far away from customers, systems, staff, partners, and suppliers. This delay can lower the value of data, if a customer goes to another website with a better response time, or if a logistics company doesn’t see a traffic accident notification. Chetan explains to Datanami how Macrometa addresses this problem with a 

, that is a distributed resource, not a centralized resource like typical cloud providers.

In Macrometa's data mesh model, data can be stored, accessed, and processed where it originates and/or where it is needed. The result is a flexible, ultra-low-latency data layer purpose-built for global, real-time, and event-driven use cases. Data is automatically replicated across the Macrometa GDN, and API requests are routed to the nearest available location. There are over 175 

 around the world. With Macrometa, developers have the tools to build exciting new applications and they can use the data model that makes the most sense for their application. 

“The storage engine is a very small but integral part of our stack,” Chetan said to Datanami. “The real value is in the approach we have for the way we ingest data into the log, the way we collapse that log into objects in real time, and most importantly, the way we can replicate that data across hundreds of locations with transactional and consistency guarantees. That’s always been the missing piece.”

In developing Macrometa future data volumes were a consideration - which could easily be ingesting trillions of events per second per the article. At its heart, Macrometa's architecture is a geo distributed event source with a materialized view engine and 

. Macrometa manages changes at the atomic field level and merges changes made across the network to maintain a single version of the truth via CRDTs, showcasing the power and versatility of CRDTs as a regular JSON database and API.

The article depicts how Macrometa transforms all data changes into a CRDT operation, which is then replicated to all the Macrometa locations using a vector clock. “With a vector clock and a causal tree of changes, Macrometa ‘s system essentially serializes and provides serialization ACID-like guarantees,” as Chetan explains in the Datanami article. “This ensures consistency without having to exchange a lot of messages with different apps.” Macrometa can store, process, and serve data within milliseconds to multiple locations around the world. In contrast, the internal messaging required within 

 can significantly lower performance if they expand past four or five locations around the world.

 ”three-layered cake”: a real-time, geo-distributed storage layer, a compute layer to process data to run real-time apps close to your customers, and a data governance layer to help organizations comply with regulatory and legal standards.

Base layer to store and ingest data - Global Data Mesh

As big and fast data ebbs and flows in all directions, developers and enterprises and everyone that relies on data for decisions need a simplified way to quickly address different types of data. The Global Data Mesh has all the benefits of a NoSQL database with KV, doc, and graph stores - plus Macrometa Streams with pub/sub and messaging queues.

Middle layer bringing it together - Edge Compute

“In our platform, streams and tables are the same things,” Chetan explained to Datanami. “It’s just that streams are real time user tables. And so you can interact with your data in both real time, in-motion fashion with streams, via pub/sub, or you can query it using request-response with SQL.”

What separates Macrometa from other data storage solutions is that it brings 

 closer to people and where data is generated, regardless of where that is. 

 lets developers create simple REST APIs on top of the data mesh. 

 enables Complex Event Processing (CEP) functions and Stream Processing workloads - in minutes instead of days or months. With Stream Workers, data could come from different sources (GDN streams, GDN Database, HTTP endpoints, Kafka, and MQTT etc.) and can be published to different sinks or stores. 

 also allows you to transform data from one data type to another, aggregate streams, and clean and filter data. This CEP engine automatically creates objects like streams, collections, and even tables and remote databases. 

Top layer keeping data separate and safe - Data Protection

 supports geo-pinning or geo-fencing to address data sovereignty use cases. Developers and operations can easily set up 

The icing on the cake - a complete Edge-as-a-Service platform

Chetan summarized for Datanami, “At the end of the day, the Macrometa platform essentially deliver a full database, a 

Archive

Inside Macrometa 2022, And A Blazing Start To An Excitingly Futuristic 2023!

Driving Low Latency With Global PoPs

How to Create Better Gaming Experiences on the Edge

A Data Mesh Is The New Octopus Garden

Computing On The Edge: Screaming In The Cloud Podcast Recap

Macrometa Launches A Public Slack For The Developer Community

Has Macrometa Cracked The Code For Delivering Data Value?

The Rise Of The Wireless Cloud: How DISH Wireless And Macrometa’s Collaboration Will Make The 5G Wireless Network And Edge Powerful

Is Low Code The Future of Enterprise Edge?