![\"\"](\"https:\/\/www.baeldung.com\/wp-content\/uploads\/2021\/09\/Java-4-Featured-1024x536.png\")
<\/p>\n<\/p>\n
In this tutorial, we’ll show how to share memory between two or more JVMs running on the same machine. This capability enables very fast inter-process communication since we can move data blocks around without any I\/O operation.<\/p>\n
A process running in any modern operating system gets what’s called a virtual memory space. We call it virtual<\/em> because, although it looks like a large, continuous, and private addressable memory space, in fact, it’s made of pages<\/em> spread all over the physical RAM.<\/strong> Here, page<\/em> is just OS slang for a block of contiguous memory, whose size range depends on the particular CPU architecture in use. For x86-84, a page can be as small as 4KB or as large as 1 GB.<\/p>\n At a given time, only a fraction of this virtual space is actually mapped to physical pages. As time passes and the process starts to consume more memory for its tasks, the OS starts to allocate more physical pages and map them to the virtual space. When the demand for memory exceeds what’s physically available, the OS will start to swap out pages that are not being used at that moment to secondary storage to make room for the request.<\/p>\n A shared memory block behaves just like regular memory, but, in contrast with regular memory, it is not private to a single process<\/strong>. When a process changes the contents of any byte within this block, any other process with access to this same shared memory “sees” this change instantly.<\/p>\n This is a list of common uses for shared memory:<\/p>\n A memory-mapped file, as the name suggests, is a regular file whose contents are directly mapped to a contiguous area in the virtual memory of a process<\/strong>. This means that we can read and\/or change its contents without explicit use of I\/O operations.\u00a0The OS will detect any writes to the mapped area and will schedule a background I\/O operation to persist the modified data.<\/p>\n Since there are no guarantees on when this background operation will happen, the OS also offers a system call to flush any pending changes. This is important for use cases like database redo logs, but not needed for our inter-process communication (IPC, for short) scenario.<\/p>\n Memory-mapped files are commonly used by database servers to achieve high throughput I\/O operations, but we can also use them to bootstrap a shared-memory-based IPC mechanism. The basic idea is that all processes that need to share data map the same file and, voil\u00e0, they now have a shared memory area<\/strong>.<\/p>\n In Java, we use the FileChannel<\/em><\/a>‘s map()<\/em> method to map a region of a file into memory, which returns a MappedByteBuffer<\/em> <\/a>that allows us to access its contents:<\/p>\n The use of the SPARSE<\/em> option here is quite relevant. As long the underlying OS and file system supports it, we can map sizable memory area without actually consuming disk space.<\/strong><\/p>\n Now, let’s create a simple demo application. The Producer<\/em> application will allocate a shared memory large enough to hold 64KB of data plus a SHA1 hash (20 bytes). Next, it will start a loop where it will fill the buffer with random data, followed by its SHA1 hash. We’ll repeat this operation continuously for 30 seconds and then exit:<\/p>\n To test that we indeed can share memory, we’ll also create a Consumer<\/em> app that will read the buffer’s content, compute its hash, and compare it with the Producer<\/em>-generated one. We’ll repeat this process for 30 seconds. At each iteration, will also compute the buffer content’s hash and compare it with the one present at the buffer’s end:<\/p>\n To test our memory-sharing scheme, let’s start both programs at the same time. This is their output when running on a 3Ghz, quad-core Intel I7 machine:<\/p>\n We can see that, in many cases, the consumer detects that the expected computed values are different<\/strong>. Welcome to the wonderful world of concurrency issues!<\/p>\n The root cause for the issue we’ve seen is that we need to synchronize access to the shared memory buffer<\/strong>. The Consumer<\/em> must wait for the Producer<\/em> to finish writing the hash before it starts reading the data. On the other hand, the Producer<\/em> also must wait for the Consumer<\/em> to finish consuming the data before writing to it again.<\/p>\n For a regular multithreaded application, solving this issue is no big deal. The standard library offers several synchronization primitives that allow us to control who can write to the shared memory at a given time.<\/p>\n However, ours is a multi-JVM scenario, so none of those standard methods apply. So, what should we do? Well, the short answer is that we’ll have to cheat<\/strong>. We could resort to OS-specific mechanisms like semaphores, but this would hinder our application’s portability. Also, this implies using JNI or JNA, which also complicates things.<\/p>\n Enter Unsafe<\/em><\/a><\/strong>. Despite its somewhat scary name, this standard library class offers exactly what we need to implement a simple lock mechanism: the compareAndSwapInt()<\/em> method.<\/p>\n This method implements an atomic test-and-set primitive that takes four arguments. Although not clearly stated in the documentation, it can target not only Java objects but also a raw memory address<\/strong>. For the latter, we pass null<\/em> in the first argument, which makes it treat the\u00a0offset <\/em>argument as a virtual memory address.<\/p>\n When we call this method, it will first check the value at the target address and compare it with the\u00a0expected<\/em> value. If they’re equal, then it will modify the location’s content to the new value and return true<\/em> indicating success. If the value at the location is different from\u00a0expected<\/em>, nothing happens, and the method returns false.<\/em><\/p>\n More importantly, this atomic operation is guaranteed to work even in multicore architectures, which is a critical feature for synchronizing multiple executing threads.<\/strong><\/p>\n Let’s create a SpinLock<\/em> class that takes advantage of this method to implement a (very!) simple lock mechanism:<\/p>\n This implementation lacks key features, like checking whether it owns the lock before releasing it, but it will suffice for our purpose.<\/p>\n Okay, so how do we get the memory address that we’ll use to store the lock status? This must be an address within the shared memory buffer so both processes can use it, but the MappedByteBuffer<\/em> class does not expose the actual memory address.<\/p>\n Inspecting the object that map()<\/em> returns, we can see that it is a DirectByteBuffer.<\/em> This class has a public method called address()<\/em> that returns exactly what we want. Unfortunately, this class is package-private so we can’t use a simple cast to access this method.<\/strong><\/p>\n To bypass this limitation, we’ll cheat a little again and use reflection to invoke this method:<\/p>\n Here, we’re using setAccessible()<\/em> to make the address()<\/em> method callable through the Method<\/em> handle. However, be aware that, from Java 17 onwards, this technique won’t work unless we explicitly use the runtime \u2013add-opens<\/em> flag.<\/strong><\/p>\n Now that we have a lock mechanism, let’s apply it to the Producer<\/em> first. For the purposes of this demo, we’ll assume that the Producer\u00a0<\/em>will always start before the\u00a0Consumer.\u00a0<\/em>We need this so we can initialize the buffer, clearing its content including the area we’ll use with the SpinLock:<\/em><\/p>\n Compared to the unsynchronized version, there are just minor changes:<\/p>\n Now, let’s apply similar changes to the\u00a0Consumer\u00a0<\/em>side:<\/p>\n With those changes, we can now run both sides and compare them with the previous result:<\/p>\n As expected, the reported iteration count will be lower compared to the non-synchronized version<\/strong>. The main reason is that we spend most part of the time within the critical section of the code holding the lock. Whichever program holding the lock prevents the other side from doing anything.<\/p>\n If we compare the average iteration count reported from the first case, it will be approximately the same as the sum of iterations we got this time. This shows that the overhead added by the lock mechanism itself is minimal.<\/p>\n In this tutorial, we’ve explored how to use share a memory area between two JVMs running on the same machine. We can use the technique presented here as the foundation for high-throughput, low-latency inter-process communication libraries.<\/p>\n As usual, all code is available over on GitHub<\/a>.<\/p>\n \u7acb\u523b\u8a3b\u518a\u53ca\u5831\u540d\u96fb\u8166\u88dc\u7fd2\u8ab2\u7a0b\u5427! <\/a> www.ITSec.vip<\/a> www.Sraa.com.hk<\/a> www.ITSec.hk<\/a> www.Penetrationtest.hk<\/a> www.ITSeceu.uk<\/a> Learn how to use share a memory area between two JVMs running on the same machine.<\/p>\n\n
3. Shared Memory and Memory-Mapped Files<\/h2>\n
<\/div>\n4. Creating Memory-Mapped Files in Java<\/h2>\n
<\/div>\nMappedByteBuffer createSharedMemory(String path, long size) {\r\n try (FileChannel fc = (FileChannel)Files.newByteChannel(new File(path).toPath(),\r\n EnumSet.of(\r\n StandardOpenOption.CREATE,\r\n StandardOpenOption.SPARSE,\r\n StandardOpenOption.WRITE,\r\n StandardOpenOption.READ))) {\r\n return fc.map(FileChannel.MapMode.READ_WRITE, 0, size);\r\n }\r\n catch( IOException ioe) {\r\n throw new RuntimeException(ioe);\r\n }\r\n}\r\n<\/code><\/pre>\n\/\/ ... SHA1 digest initialization omitted\r\nMappedByteBuffer shm = createSharedMemory("some_path.dat", 64*1024 + 20);\r\nRandom rnd = new Random();\r\nlong start = System.currentTimeMillis();\r\nlong iterations = 0;\r\nint capacity = shm.capacity();\r\nSystem.out.println("Starting producer iterations...");\r\nwhile(System.currentTimeMillis() - start < 30000) {\r\n for (int i = 0; i < capacity - hashLen; i++) {\r\n byte value = (byte) (rnd.nextInt(256) & 0x00ff);\r\n digest.update(value);\r\n shm.put(i, value);\r\n }\r\n \/\/ Write hash at the end\r\n byte[] hash = digest.digest();\r\n shm.put(capacity - hashLen, hash);\r\n iterations++;\r\n}\r\nSystem.out.printf("%d iterations run\\n", iterations);\r\n<\/code><\/pre>\n\/\/ ... digest initialization omitted\r\nMappedByteBuffer shm = createSharedMemory("some_path.dat", 64*1024 + 20);\r\nlong start = System.currentTimeMillis();\r\nlong iterations = 0;\r\nint capacity = shm.capacity();\r\nSystem.out.println("Starting consumer iterations...");\r\nlong matchCount = 0;\r\nlong mismatchCount = 0;\r\nbyte[] expectedHash = new byte[hashLen];\r\nwhile (System.currentTimeMillis() - start < 30000) {\r\n for (int i = 0; i < capacity - 20; i++) {\r\n byte value = shm.get(i);\r\n digest.update(value);\r\n }\r\n byte[] hash = digest.digest();\r\n shm.get(capacity - hashLen, expectedHash);\r\n if (Arrays.equals(hash, expectedHash)) {\r\n matchCount++;\r\n } else {\r\n mismatchCount++;\r\n }\r\n iterations++;\r\n}\r\nSystem.out.printf("%d iterations run. matches=%d, mismatches=%d\\n", iterations, matchCount, mismatchCount);<\/code><\/pre>\n# Producer output\r\nStarting producer iterations...\r\n11722 iterations run\r\n# Consumer output\r\nStarting consumer iterations...\r\n18893 iterations run. matches=11714, mismatches=7179\r\n<\/code><\/pre>\n5. Synchronizing Shared Memory Access<\/h2>\n
<\/div>\n\/\/... package and imports omitted\r\npublic class SpinLock {\r\n private static final Unsafe unsafe;\r\n \/\/ ... unsafe initialization omitted\r\n private final long addr;\r\n public SpinLock(long addr) {\r\n this.addr = addr;\r\n }\r\n public boolean tryLock(long maxWait) {\r\n long deadline = System.currentTimeMillis() + maxWait;\r\n while (System.currentTimeMillis() < deadline ) {\r\n if (unsafe.compareAndSwapInt(null, addr, 0, 1)) {\r\n return true;\r\n }\r\n }\r\n return false;\r\n }\r\n public void unlock() {\r\n unsafe.putInt(addr, 0);\r\n }\r\n}\r\n<\/code><\/pre>\nprivate static long getBufferAddress(MappedByteBuffer shm) {\r\n try {\r\n Class<?> cls = shm.getClass();\r\n Method maddr = cls.getMethod("address");\r\n maddr.setAccessible(true);\r\n Long addr = (Long) maddr.invoke(shm);\r\n if (addr == null) {\r\n throw new RuntimeException("Unable to retrieve buffer's address");\r\n }\r\n return addr;\r\n } catch (NoSuchMethodException | InvocationTargetException | IllegalAccessException ex) {\r\n throw new RuntimeException(ex);\r\n }\r\n}\r\n<\/code><\/pre>\n6. Adding Synchronization to Producer<\/em> and\u00a0Consumer<\/em><\/h2>\n
<\/div>\npublic static void main(String[] args) throws Exception {\r\n \/\/ ... digest initialization omitted\r\n MappedByteBuffer shm = createSharedMemory("some_path.dat", 64*1024 + 20);\r\n \/\/ Cleanup lock area \r\n shm.putInt(0, 0);\r\n long addr = getBufferAddress(shm);\r\n System.out.println("Starting producer iterations...");\r\n long start = System.currentTimeMillis();\r\n long iterations = 0;\r\n Random rnd = new Random();\r\n int capacity = shm.capacity();\r\n SpinLock lock = new SpinLock(addr);\r\n while(System.currentTimeMillis() - start < 30000) {\r\n if (!lock.tryLock(5000)) {\r\n throw new RuntimeException("Unable to acquire lock");\r\n }\r\n try {\r\n \/\/ Skip the first 4 bytes, as they're used by the lock\r\n for (int i = 4; i < capacity - hashLen; i++) {\r\n byte value = (byte) (rnd.nextInt(256) & 0x00ff);\r\n digest.update(value);\r\n shm.put(i, value);\r\n }\r\n \/\/ Write hash at the end\r\n byte[] hash = digest.digest();\r\n shm.put(capacity - hashLen, hash);\r\n iterations++;\r\n }\r\n finally {\r\n lock.unlock();\r\n }\r\n }\r\n System.out.printf("%d iterations run\\n", iterations);\r\n}\r\n<\/code><\/pre>\n\n
private static void main(String args[]) throws Exception {\r\n \/\/ ... digest initialization omitted\r\n MappedByteBuffer shm = createSharedMemory("some_path.dat", 64*1024 + 20);\r\n long addr = getBufferAddress(shm);\r\n System.out.println("Starting consumer iterations...");\r\n Random rnd = new Random();\r\n long start = System.currentTimeMillis();\r\n long iterations = 0;\r\n int capacity = shm.capacity();\r\n long matchCount = 0;\r\n long mismatchCount = 0;\r\n byte[] expectedHash = new byte[hashLen];\r\n SpinLock lock = new SpinLock(addr);\r\n while (System.currentTimeMillis() - start < 30000) {\r\n if (!lock.tryLock(5000)) {\r\n throw new RuntimeException("Unable to acquire lock");\r\n }\r\n try {\r\n for (int i = 4; i < capacity - hashLen; i++) {\r\n byte value = shm.get(i);\r\n digest.update(value);\r\n }\r\n byte[] hash = digest.digest();\r\n shm.get(capacity - hashLen, expectedHash);\r\n if (Arrays.equals(hash, expectedHash)) {\r\n matchCount++;\r\n } else {\r\n mismatchCount++;\r\n }\r\n iterations++;\r\n } finally {\r\n lock.unlock();\r\n }\r\n }\r\n System.out.printf("%d iterations run. matches=%d, mismatches=%d\\n", iterations, matchCount, mismatchCount);\r\n}\r\n<\/code><\/pre>\n# Producer output\r\nStarting producer iterations...\r\n8543 iterations run\r\n# Consumer output\r\nStarting consumer iterations...\r\n8607 iterations run. matches=8607, mismatches=0\r\n<\/code><\/pre>\n6. Conclusion<\/h2>\n
<\/div>\n<\/p>\n
![](\"https:\/\/assets.feedblitz.com\/i\/fblike20.png\")
<\/a> ![](\"https:\/\/assets.feedblitz.com\/i\/pinterest20.png\")
<\/a> ![](\"https:\/\/assets.feedblitz.com\/i\/twitter20.png\")
<\/a> ![](\"https:\/\/assets.feedblitz.com\/i\/email20.png\")
<\/a> ![](\"https:\/\/assets.feedblitz.com\/i\/rss20.png\")
<\/a> ![](\"https:\/\/assets.feedblitz.com\/i\/comments20.png\")
<\/a> ![](\"https:\/\/assets.feedblitz.com\/i\/commentsrss20.png\")
<\/a> <\/div>\n\nCommercials Cooperation Advertisements:<\/b><\/h2>\r\n
(1) IT Teacher IT Freelance
<\/p>\r\n
<\/a>
\r\n\r\n\u7535\u5b50\u8ba1\u7b97\u673a -\u6559\u80b2 -IT \u96fb\u8166\u73ed\u201d ( IT\u96fb\u8166\u88dc\u7fd2 ) \u63d0\u4f9b\u4e00\u500b\u65b9\u4fbf\u7684\u7535\u5b50\u8ba1\u7b97\u673a \u6559\u80b2\u5e73\u53f0, \u70ba\u5927\u5bb6\u914d\u5c0d\u4fe1\u606f\u6280\u672f, \u96fb\u8166 \u8001\u5e2b, IT freelance \u548c programming expert. \u8b93\u5927\u5bb6\u65b9\u4fbf\u5730\u5c31\u80fd\u627e\u5230\u5408\u9069\u7684\u96fb\u8166\u88dc\u7fd2, \u96fb\u8166\u73ed, \u5bb6\u6559, \u79c1\u4eba\u8001\u5e2b.
\r\n\r\nWe are a education and information platform which you can find a IT private tutorial teacher or freelance.
\r\n\r\nAlso we provide different information about information technology, Computer, programming, mobile, Android, apple, game, movie, anime, animation\u2026 \r\n<\/p>\n
(2) ITSec
<\/p>
<\/a> \r\n
\r\n
\r\n
\r\n
\r\n
\r\n
\r\nSecure Your Computers from Cyber Threats and mitigate risks with professional services to defend Hackers.
\r\nITSec provide IT Security and Compliance Services, including IT Compliance Services, Risk Assessment, IT Audit, Security Assessment and Audit, ISO 27001 Consulting and Certification, GDPR Compliance Services, Privacy Impact Assessment (PIA), Penetration test, Ethical Hacking, Vulnerabilities scan, IT Consulting, Data Privacy Consulting, Data Protection Services, Information Security Consulting, Cyber Security Consulting, Network Security Audit, Security Awareness Training. \r\n
Contact us right away.
Email (Prefer using email to contact us):
SalesExecutive@ITSec.vip<\/p>","protected":false},"excerpt":{"rendered":"<\/p>\n<\/a>\u00a0<\/a>\u00a0<\/a>\u00a0<\/a>\u00a0<\/a>\u00a0<\/a>\u00a0<\/a>\u00a0<\/div>\n","protected":false},"author":1406,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_monsterinsights_skip_tracking":false,"_monsterinsights_sitenote_active":false,"_monsterinsights_sitenote_note":"","_monsterinsights_sitenote_category":0,"site-container-style":"default","site-container-layout":"default","site-sidebar-layout":"default","disable-article-header":"default","disable-site-header":"default","disable-site-footer":"default","disable-content-area-spacing":"default","footnotes":""},"categories":[22],"tags":[61,122,127,129,124,128,125,132,131,133,126,130,123,66,94,88,97,56,64,65,60,112,40,75,95,104,33,120,105,101,98,115,30,29,41,86,70,69,68,72,71,26,118,108,87,46,55,48,52,54,51,50,83,62,58,57,14446,109,35,59,63,85,79,82,96,80,27,81,114,44,42,43,45,38,39,110,117,100,111,116,73,89,90,92,91,93,84,78,37,102,34,36,77,67,74,99,113,119,28,121,32,47,49,53,103,31,76],"class_list":["post-46200","post","type-post","status-publish","format-standard","hentry","category-mobile","tag-airpods","tag-anime","tag-anime-characters","tag-anime-cosplay","tag-anime-edits","tag-anime-merchandise","tag-anime-movies","tag-anime-news","tag-anime-recommendations","tag-anime-reviews","tag-anime-series","tag-anime-streaming","tag-animes","tag-app-store","tag-app-store-samsung","tag-appgallery","tag-appgallery-oneplus","tag-apple","tag-apple-music","tag-apple-tv","tag-apple-watch","tag-bbc-sport","tag-best-mobile-games","tag-bixby","tag-bixby-xiaomi","tag-champions-league","tag-cyberpunk","tag-cyberpunk-2077","tag-fantasy-football","tag-fifa","tag-football","tag-formula-1","tag-fortnite","tag-free-fire","tag-free-mobile-games","tag-freebuds-pro","tag-galaxy-a52","tag-galaxy-note-20","tag-galaxy-s21","tag-galaxy-watch-4","tag-galaxy-z-fold-3","tag-game","tag-games","tag-golf","tag-harmonyos","tag-how-to-backup-iphone","tag-how-to-factory-reset-iphone","tag-how-to-reset-iphone","tag-how-to-restore-iphone","tag-how-to-unlock-iphone","tag-how-to-unlock-iphone-5","tag-how-to-unlock-iphone-6","tag-huawei","tag-ios","tag-ipad","tag-iphone","tag-jvm","tag-live-soccer","tag-lol","tag-macbook","tag-macos","tag-mate-40-pro","tag-mi-11-lite","tag-mi-home-security-camera-basic-1080p","tag-mi-home-security-camera-basic-1080p-huawei","tag-mi-smart-band-6","tag-minecraft","tag-miui","tag-mlb-scores","tag-mobile-game-design","tag-mobile-game-development","tag-mobile-game-marketing","tag-mobile-game-monetization","tag-mobile-games","tag-mobile-gaming","tag-nba-scores","tag-nba-standings","tag-nfl","tag-nfl-scores","tag-nhl-scores","tag-one-ui","tag-oneplus","tag-oneplus-9-pro","tag-oneplus-buds-pro","tag-oneplus-nord-ce-5g","tag-oxygenos","tag-p40-pro-plus","tag-poco-x3-pro","tag-pokemon","tag-premier-league","tag-pubg","tag-pubg-mobile","tag-redmi-note-10-pro","tag-samsung","tag-samsung-pay","tag-soccer","tag-sports","tag-steam","tag-steeam","tag-top-10-anime","tag-valorant","tag-when-do-the-iphone-7-come-out","tag-when-does-the-iphone-7-come-out","tag-when-is-the-iphone-7-coming-out","tag-world-cup","tag-xbox-series-x","tag-xiaomi"],"aioseo_notices":[],"_links":{"self":[{"href":"https:\/\/gamefootballmobileanimeiphone.com\/index.php\/wp-json\/wp\/v2\/posts\/46200","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/gamefootballmobileanimeiphone.com\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/gamefootballmobileanimeiphone.com\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/gamefootballmobileanimeiphone.com\/index.php\/wp-json\/wp\/v2\/users\/1406"}],"replies":[{"embeddable":true,"href":"https:\/\/gamefootballmobileanimeiphone.com\/index.php\/wp-json\/wp\/v2\/comments?post=46200"}],"version-history":[{"count":0,"href":"https:\/\/gamefootballmobileanimeiphone.com\/index.php\/wp-json\/wp\/v2\/posts\/46200\/revisions"}],"wp:attachment":[{"href":"https:\/\/gamefootballmobileanimeiphone.com\/index.php\/wp-json\/wp\/v2\/media?parent=46200"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/gamefootballmobileanimeiphone.com\/index.php\/wp-json\/wp\/v2\/categories?post=46200"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/gamefootballmobileanimeiphone.com\/index.php\/wp-json\/wp\/v2\/tags?post=46200"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}