Advanced Programming in the UNIX Environment: Second Edition [Electronic resources] نسخه متنی

اینجــــا یک کتابخانه دیجیتالی است

با بیش از 100000 منبع الکترونیکی رایگان به زبان فارسی ، عربی و انگلیسی

Advanced Programming in the UNIX Environment: Second Edition [Electronic resources] - نسخه متنی

W. Richard Stevens; Stephen A. Rago

| نمايش فراداده ، افزودن یک نقد و بررسی
افزودن به کتابخانه شخصی
ارسال به دوستان
جستجو در متن کتاب
بیشتر
تنظیمات قلم

فونت

اندازه قلم

+ - پیش فرض

حالت نمایش

روز نیمروز شب
جستجو در لغت نامه
بیشتر
لیست موضوعات
توضیحات
افزودن یادداشت جدید












  • 15.9. Shared Memory


    Shared memory allows two or more processes to share a given region of memory. This is the fastest form of IPC, because the data does not need to be copied between the client and the server. The only trick in using shared memory is synchronizing access to a given region among multiple processes. If the server is placing data into a shared memory region, the client shouldn't try to access the data until the server is done. Often, semaphores are used to synchronize shared memory access. (But as we saw at the end of the previous section, record locking can also be used.)


    The Single UNIX Specification includes an alternate set of interfaces to access shared memory in the shared memory objects option of its real-time extensions. We do not cover the real-time extensions in this text.


    The kernel maintains a structure with at least the following members for each shared memory segment:


    struct shmid_ds {
    struct ipc_perm shm_perm; /* see Section 15.6.2 */
    size_t shm_segsz; /* size of segment in bytes */
    pid_t shm_lpid; /* pid of last shmop() */
    pid_t shm_cpid; /* pid of creator */
    shmatt_t shm_nattch; /* number of current attaches */
    time_t shm_atime; /* last-attach time */
    time_t shm_dtime; /* last-detach time */
    time_t shm_ctime; /* last-change time */
    .
    .
    .
    };

    Section 15.6.3) that affect shared memory.

    Figure 15.30. System limits that affect shared memory

    Description

    Typical values

    FreeBSD 5.2.1

    Linux 2.4.22

    Mac OS X 10.3

    Solaris 9

    The maximum size in bytes of a shared memory segment

    33,554,432

    33,554,432

    4,194,304

    8,388,608

    The minimum size in bytes of a shared memory segment

    1

    1

    1

    1

    The maximum number of shared memory segments, systemwide

    192

    4,096

    32

    100

    The maximum number of shared memory segments, per process

    128

    4,096

    8

    6

    The first function called is usually shmget, to obtain a shared memory identifier.


    #include <sys/shm.h>
    int shmget(key_t

    key , size_t

    size , int

    flag );

    Returns: shared memory ID if OK, 1 on error

    In Section 15.6.1, we described the rules for converting the

    key into an identifier and whether a new segment is created or an existing segment is referenced. When a new segment is created, the following members of the shmid_ds structure are initialized.

    • The ipc_perm structure is initialized as described in Section 15.6.2. The mode member of this structure is set to the corresponding permission bits of

      flag . These permissions are specified with the values from Figure 15.24.

    • shm_lpid, shm_nattach, shm_atime, and shm_dtime are all set to 0.

    • shm_ctime is set to the current time.

    • shm_segsz is set to the

      size requested.


    The

    size parameter is the size of the shared memory segment in bytes. Implementations will usually round up the size to a multiple of the system's page size, but if an application specifies

    size as a value other than an integral multiple of the system's page size, the remainder of the last page will be unavailable for use. If a new segment is being created (typically in the server), we must specify its

    size . If we are referencing an existing segment (a client), we can specify

    size as 0. When a new segment is created, the contents of the segment are initialized with zeros.

    The shmctl function is the catchall for various shared memory operations.


    #include <sys/shm.h>
    int shmctl(int

    shmid , int

    cmd , struct shmid_ds *

    buf );

    Returns: 0 if OK, 1 on error

    The

    cmd argument specifies one of the following five commands to be performed, on the segment specified by

    shmid .

    IPC_STAT

    Fetch the shmid_ds structure for this segment, storing it in the structure pointed to by

    buf .

    IPC_SET

    Set the following three fields from the structure pointed to by

    buf in the shmid_ds structure associated with this shared memory segment: shm_perm.uid, shm_perm.gid, and shm_perm.mode. This command can be executed only by a process whose effective user ID equals shm_perm.cuid or shm_perm.uid or by a process with superuser privileges.

    IPC_RMID

    Remove the shared memory segment set from the system. Since an attachment count is maintained for shared memory segments (the shm_nattch field in the shmid_ds structure), the segment is not removed until the last process using the segment terminates or detaches it. Regardless of whether the segment is still in use, the segment's identifier is immediately removed so that shmat can no longer attach the segment. This command can be executed only by a process whose effective user ID equals shm_perm.cuid or shm_perm.uid or by a process with superuser privileges.

    Two additional commands are provided by Linux and Solaris, but are not part of the Single UNIX Specification.

    SHM_LOCK

    Lock the shared memory segment in memory. This command can be executed only by the superuser.

    SHM_UNLOCK

    Unlock the shared memory segment. This command can be executed only by the superuser.

    Once a shared memory segment has been created, a process attaches it to its address space by calling shmat.



    #include <sys/shm.h>
    void *shmat(int

    shmid , const void *

    addr , int

    flag );

    Returns: pointer to shared memory segment if OK, 1 on error

    The address in the calling process at which the segment is attached depends on the

    addr argument and whether the SHM_RND bit is specified in

    flag .

    • If

      addr is 0, the segment is attached at the first available address selected by the kernel. This is the recommended technique.

    • If

      addr is nonzero and SHM_RND is not specified, the segment is attached at the address given by

      addr .

    • If

      addr is nonzero and SHM_RND is specified, the segment is attached at the address given by

      (addr -

      (addr modulus SHMLBA

      )) . The SHM_RND command stands for "round." SHMLBA stands for "low boundary address multiple" and is always a power of 2. What the arithmetic does is round the address down to the next multiple of SHMLBA.


    Unless we plan to run the application on only a single type of hardware (which is highly unlikely today), we should not specify the address where the segment is to be attached. Instead, we should specify an

    addr of 0 and let the system choose the address.

    If the SHM_RDONLY bit is specified in

    flag , the segment is attached read-only. Otherwise, the segment is attached readwrite.

    The value returned by shmat is the address at which the segment is attached, or 1 if an error occurred. If shmat succeeds, the kernel will increment the shm_nattch counter in the shmid_ds structure associated with the shared memory segment.

    When we're done with a shared memory segment, we call shmdt to detach it. Note that this does not remove the identifier and its associated data structure from the system. The identifier remains in existence until some process (often a server) specifically removes it by calling shmctl with a command of IPC_RMID.


    #include <sys/shm.h>
    int shmdt(void *

    addr );

    Returns: 0 if OK, 1 on error

    The

    addr argument is the value that was returned by a previous call to shmat. If successful, shmdt will decrement the shm_nattch counter in the associated shmid_ds structure.


    Example

    Where a kernel places shared memory segments that are attached with an address of 0 is highly system dependent. Figure 15.31 shows a program that prints some information on where one particular system places various types of data.

    Running this program on an Intel-based Linux system gives us the following output:


    $

    ./a.out
    array[] from 804a080 to 8053cc0
    stack around bffff9e4
    malloced from 8053cc8 to 806c368
    shared memory attached from 40162000 to 4017a6a0

    Figure 7.6. Note that the shared memory segment is placed well below the stack.


    Figure 15.31. Print where various types of data are stored


    #include "apue.h"
    #include <sys/shm.h>
    #define ARRAY_SIZE 40000
    #define MALLOC_SIZE 100000
    #define SHM_SIZE 100000
    #define SHM_MODE 0600 /* user read/write */
    char array[ARRAY_SIZE]; /* uninitialized data = bss */
    int
    main(void)
    {
    int shmid;
    char *ptr, *shmptr;
    printf("array[] from %lx to %lx\n", (unsigned long)&array[0],
    (unsigned long)&array[ARRAY_SIZE]);
    printf("stack around %lx\n", (unsigned long)&shmid);
    if ((ptr = malloc(MALLOC_SIZE)) == NULL)
    err_sys("malloc error");
    printf("malloced from %lx to %lx\n", (unsigned long)ptr,
    (unsigned long)ptr+MALLOC_SIZE);
    if ((shmid = shmget(IPC_PRIVATE, SHM_SIZE, SHM_MODE)) < 0)
    err_sys("shmget error");
    if ((shmptr = shmat(shmid, 0, 0)) == (void *)-1)
    err_sys("shmat error");
    printf("shared memory attached from %lx to %lx\n",
    (unsigned long)shmptr, (unsigned long)shmptr+SHM_SIZE);
    if (shmctl(shmid, IPC_RMID, 0) < 0)
    err_sys("shmctl error");
    exit(0);
    }


    Figure 15.32. Memory layout on an Intel-based Linux system

    Section 14.9) can be used to map portions of a file into the address space of a process. This is conceptually similar to attaching a shared memory segment using the shmat XSI IPC function. The main difference is that the memory segment mapped with mmap is backed by a file, whereas no file is associated with an XSI shared memory segment.


    ExampleMemory Mapping of /dev/zero

    Shared memory can be used between unrelated processes. But if the processes are related, some implementations provide a different technique.


    The following technique works on FreeBSD 5.2.1, Linux 2.4.22, and Solaris 9. Mac OS X 10.3 currently doesn't support the mapping of character devices into the address space of a process.


    The device /dev/zero is an infinite source of 0 bytes when read. This device also accepts any data that is written to it, ignoring the data. Our interest in this device for IPC arises from its special properties when it is memory mapped.

    • An unnamed memory region is created whose size is the second argument to mmap, rounded up to the nearest page size on the system.

    • The memory region is initialized to 0.

    • Multiple processes can share this region if a common ancestor specifies the MAP_SHARED flag to mmap.


    The program in Section 8.9. The memory-mapped region is initialized to 0 by mmap. The parent increments it to 1, then the child increments it to 2, then the parent increments it to 3, and so on. Note that we have to use parentheses when we increment the value of the long integer in the update function, since we are incrementing the value and not the pointer.

    The advantage of using /dev/zero in the manner that we've shown is that an actual file need not exist before we call mmap to create the mapped region. Mapping /dev/zero automatically creates a mapped region of the specified size. The disadvantage of this technique is that it works only between related processes. With related processes, however, it is probably simpler and more efficient to use threads (Chapters 11 and 12). Note that regardless of which technique is used, we still need to synchronize access to the shared data.


    Figure 15.33. IPC between parent and child using memory mapped I/O of /dev/zero


    #include "apue.h"
    #include <fcntl.h>
    #include <sys/mman.h>
    #define NLOOPS 1000
    #define SIZE sizeof(long) /* size of shared memory area */
    static int
    update(long *ptr)
    {
    return((*ptr)++); /* return value before increment */
    }
    int
    main(void)
    {
    int fd, i, counter;
    pid_t pid;
    void *area;
    if ((fd = open("/dev/zero", O_RDWR)) < 0)
    err_sys("open error");
    if ((area = mmap(0, SIZE, PROT_READ | PROT_WRITE, MAP_SHARED,
    fd, 0)) == MAP_FAILED)
    err_sys("mmap error");
    close(fd); /* can close /dev/zero now that it's mapped */
    TELL_WAIT();
    if ((pid = fork()) < 0) {
    err_sys("fork error");
    } else if (pid > 0) { /* parent */
    for (i = 0; i < NLOOPS; i += 2) {
    if ((counter = update((long *)area)) != i)
    err_quit("parent: expected %d, got %d", i, counter);
    TELL_CHILD(pid);
    WAIT_CHILD();
    }
    } else { /* child */
    for (i = 1; i < NLOOPS + 1; i += 2) {
    WAIT_PARENT();
    if ((counter = update((long *)area)) != i)
    err_quit("child: expected %d, got %d", i, counter);
    TELL_PARENT(getppid());
    }
    }
    exit(0);
    }


    ExampleAnonymous Memory Mapping

    Many implementations provide anonymous memory mapping, a facility similar to the /dev/zero feature. To use this facility, we specify the MAP_ANON flag to mmap and specify the file descriptor as -1. The resulting region is anonymous (since it's not associated with a pathname through a file descriptor) and creates a memory region that can be shared with descendant processes.


    The anonymous memory-mapping facility is supported by all four platforms discussed in this text. Note, however, that Linux defines the MAP_ANONYMOUS flag for this facility, but defines the MAP_ANON flag to be the same value for improved application portability.


    To modify the program in Figure 15.33 to use this facility, we make three changes: (a) remove the open of /dev/zero, (b) remove the close of fd, and (c) change the call to mmap to the following:


    if ((area = mmap(0, SIZE, PROT_READ | PROT_WRITE,
    MAP_ANON | MAP_SHARED, -1, 0)) == MAP_FAILED)

    In this call, we specify the MAP_ANON flag and set the file descriptor to -1. The rest of the program from

  • / 369