Examples of CachingDataStore

com.sun.sgs.impl.service.data.store.cache.CachingDataStore
Provides an implementation of {@link DataStore} that caches data on thelocal node and communicates with a {@link CachingDataStoreServer}. The caching data store requires the use of an access coordinator that performs pessimistic locking, such as {@link LockingAccessCoordinator}.
The {@link #CachingDataStore constructor} supports the followingconfiguration properties:

Property: {@value #CALLBACK_PORT_PROPERTY}
Default: {@value #DEFAULT_CALLBACK_PORT}
The network port used to accept callback requests. The value must be a non-negative number less than 65536. If the value specified is 0, then an anonymous port will be chosen.

Property: {@value #EVICTION_BATCH_SIZE_PROPERTY}
Default: {@value #DEFAULT_EVICTION_BATCH_SIZE}
The number of entries to consider when selecting a single candidate for eviction. The value must be greater than 0 and no larger than the cache size.

Property: {@value #EVICTION_RESERVE_SIZE_PROPERTY}
Default: {@value #DEFAULT_EVICTION_RESERVE_SIZE}
The number of cache entries to hold in reserve for use while searching for eviction candidates. The value must be greater than 0 and no larger than the cache size.

Property: {@value #LOCK_TIMEOUT_PROPERTY}
Default: {@value #DEFAULT_LOCK_TIMEOUT_PROPORTION} times the transaction timeout.
The maximum amount of time in milliseconds that an attempt to obtain a lock will be allowed to continue before being aborted. The value must be greater than 0, and should be less than the transaction timeout.

Property: {@value #MAX_RETRY_PROPERTY}
Default: {@value #DEFAULT_MAX_RETRY}
The number of milliseconds to continue retrying I/O operations before determining that the failure is permanent. The value must be non-negative.

Property: {@value #NUM_LOCKS_PROPERTY}
Default: {@value #DEFAULT_NUM_LOCKS}
The number of locks used by the cache. The value must be greater than 0. The number of cache locks controls the amount of concurrency.

Property: {@value #RETRY_WAIT_PROPERTY}
Default: {@value #DEFAULT_RETRY_WAIT}
The number of milliseconds to wait before retrying a failed I/O operation. The value must be non-negative.

Property: {@value #SERVER_HOST_PROPERTY}
Default: the value of the {@value com.sun.sgs.impl.kernel.StandardProperties#SERVER_HOST} property, if present, or localhost if this node is starting the server
The name of the host running the {@code CachingDataStoreServer}.

Property: {@value com.sun.sgs.impl.service.data.store.cache.server.CachingDataStoreServerImpl#SERVER_PORT_PROPERTY}
Default: {@value com.sun.sgs.impl.service.data.store.cache.server.CachingDataStoreServerImpl#DEFAULT_SERVER_PORT}
The network port used to make server requests. The value must be a non-negative number less than 65536. The value 0 can only be specified if the {@link StandardProperties#NODE_TYPE} property is not appNode and means that an anonymous port will be chosen for running the server.

Property: {@value #CACHE_SIZE_PROPERTY}
Default: {@value #DEFAULT_CACHE_SIZE}
The maximum number of entries, including name bindings and objects, that can be stored in the cache. The value must be no smaller than {@value #MIN_CACHE_SIZE}.

Property: {@value #UPDATE_QUEUE_SIZE_PROPERTY}
Default: {@value #DEFAULT_UPDATE_QUEUE_SIZE}
The maximum number of commit requests that can be queued waiting to send to the server. The value must be greater than 0 and no more than 5000

This class uses the {@link Logger} named {@code com.sun.sgs.impl.service.data.store.cache.CachingDataStore} to loginformation at the following logging levels:
- {@link Level#SEVERE SEVERE} - Initialization failures
- {@link Level#CONFIG CONFIG} - Constructor properties, data storeheaders
- {@link Level#FINE FINE} - Allocating blocks of object IDs
- {@link Level#FINER FINER} - Transaction operations, class infooperations, and node shutdown
- {@link Level#FINEST FINEST} - Name and object operations
Operations that throw {@link TransactionAbortedException} will instead logthe failure to the {@code Logger} named {@code com.sun.sgs.impl.service.data.store.cache.CachingDataStore.abort}, to make it easier to debug concurrency conflicts.

org.apache.jackrabbit.core.data.CachingDataStore

A caching data store that consists of {@link LocalCache} and {@link Backend}. {@link Backend} is single source of truth. All methods first try to fetchinformation from {@link LocalCache}. If record is not available in {@link LocalCache}, then it is fetched from {@link Backend} and saved to{@link LocalCache} for further access. This class is designed to work without{@link LocalCache} and then all information is fetched from {@link Backend}. To disable {@link LocalCache} set {@link #setCacheSize(long)} to 0. Configuration:

 <DataStore class="org.apache.jackrabbit.aws.ext.ds.CachingDataStore"> <param name=" {@link #setPath(String) path}" value="/data/datastore"/> <param name=" {@link #setConfig(String) config}" value="${rep.home}/backend.properties"/> <param name=" {@link #setCacheSize(long) cacheSize}" value="68719476736"/> <param name=" {@link #setSecret(String) secret}" value="123456"/> <param name=" {@link #setCachePurgeTrigFactor(double)}" value="0.95d"/> <param name=" {@link #setCachePurgeResizeFactor(double) cacheSize}" value="0.85d"/> <param name=" {@link #setMinRecordLength(int) minRecordLength}" value="1024"/> <param name=" {@link #setContinueOnAsyncUploadFailure(boolean) continueOnAsyncUploadFailure}" value="false"/> <param name=" {@link #setConcurrentUploadsThreads(int) concurrentUploadsThreads}" value="10"/> <param name=" {@link #setAsyncUploadLimit(int) asyncUploadLimit}" value="100"/> <param name=" {@link #setUploadRetries(int) uploadRetries}" value="3"/> </DataStore>

Examples of com.sun.sgs.impl.service.data.store.cache.CachingDataStore

      Field serverPortField =
    DataStoreClient.class.getDeclaredField("serverPort");
      serverPortField.setAccessible(true);
      return (Integer) serverPortField.get(dsClient);
  } else if (dataStore instanceof CachingDataStore) {
      CachingDataStore cachingDataStore = (CachingDataStore) dataStore;
      Field localServerField =
    CachingDataStore.class.getDeclaredField("localServer");
      localServerField.setAccessible(true);
      CachingDataStoreServerImpl server = (CachingDataStoreServerImpl)
    localServerField.get(cachingDataStore);

View Full Code Here

Examples of com.sun.sgs.impl.service.data.store.cache.CachingDataStore


    /** Create a {@link CachingDataStore}. */
    @Override
    protected DataStore createDataStore(Properties props) throws Exception {
  DataStore store = new DataStoreProfileProducer(
      new CachingDataStore(props, systemRegistry, txnProxy),
      DummyProfileCoordinator.getCollector());
  DummyProfileCoordinator.startProfiling();
  store.ready();
  return store;
    }

View Full Code Here

Examples of com.sun.sgs.impl.service.data.store.cache.CachingDataStore

  props.setProperty(NODE_TYPE, nodeType);
  props.setProperty(SERVER_HOST_PROPERTY, host);
  props.setProperty(SERVER_PORT_PROPERTY, String.valueOf(port));
  props.setProperty(DIRECTORY_PROPERTY, directory);
  DataStore store = new DataStoreProfileProducer(
      new CachingDataStore(props, env.systemRegistry, txnProxy),
      DummyProfileCoordinator.getCollector());
  DummyProfileCoordinator.startProfiling();
  return store;
    }

View Full Code Here

Examples of org.apache.jackrabbit.core.data.CachingDataStore


        return dataStore;
    }


    private DataStore wrapInCachingDataStore(final DataStore dataStore, BlobStoreConfiguration config) throws Exception {
        CachingDataStore cachingStore = new CachingDataStore() {
            @Override
            protected Backend createBackend() {
                return new DataStoreWrapperBackend(dataStore);
            }


            @Override
            protected String getMarkerFile() {
                return "db.init.done";
            }
        };


        BeanUtils.populate(cachingStore, config.getConfigMap());
        cachingStore.init(null);


        return cachingStore;
    }

View Full Code Here

Examples of org.apache.jackrabbit.core.data.CachingDataStore

        }


    }
    
    private CachingDataStore createDataStore() throws RepositoryException {
        CachingDataStore ds = memoryBackend
                ? new InMemoryDataStore()
                : new S3DataStore();
        ds.setConfig(config);
        if (noCache) {
            ds.setCacheSize(0);
        }
        ds.init(TEST_DIR);
        return ds;
    }

View Full Code Here

Examples of org.apache.jackrabbit.core.data.CachingDataStore

    /**
     * Test {@link DataStore#addRecord(InputStream)} and assert length of added
     * record.
     */
    protected void doAddRecordTest() throws Exception {
        CachingDataStore ds = createDataStore();
        byte[] data = new byte[12345];
        new Random(12345).nextBytes(data);
        DataRecord rec = ds.addRecord(new ByteArrayInputStream(data));
        assertEquals(data.length, rec.getLength());
        assertRecord(data, rec);
        ds.close();
    }

View Full Code Here

Examples of org.apache.jackrabbit.core.data.CachingDataStore

    /**
     * Test {@link DataStore#getRecord(DataIdentifier)} and assert length and
     * inputstream.
     */
    protected void doGetRecordTest() throws Exception {
        CachingDataStore ds = createDataStore();
        byte[] data = new byte[12345];
        new Random(12345).nextBytes(data);
        DataRecord rec = ds.addRecord(new ByteArrayInputStream(data));
        rec = ds.getRecord(rec.getIdentifier());
        assertEquals(data.length, rec.getLength());
        assertRecord(data, rec);
        ds.close();
    }

View Full Code Here

Examples of org.apache.jackrabbit.core.data.CachingDataStore


    /**
     * Test {@link MultiDataStoreAware#deleteRecord(DataIdentifier)}.
     */
    protected void doDeleteRecordTest() throws Exception {
        CachingDataStore ds = createDataStore();
        Random random = new Random(12345);
        byte[] data1 = new byte[12345];
        random.nextBytes(data1);
        DataRecord rec1 = ds.addRecord(new ByteArrayInputStream(data1));


        byte[] data2 = new byte[12345];
        random.nextBytes(data2);
        DataRecord rec2 = ds.addRecord(new ByteArrayInputStream(data2));


        byte[] data3 = new byte[12345];
        random.nextBytes(data3);
        DataRecord rec3 = ds.addRecord(new ByteArrayInputStream(data3));


        ds.deleteRecord(rec2.getIdentifier());


        assertNull("rec2 should be null",
            ds.getRecordIfStored(rec2.getIdentifier()));
        assertEquals(new ByteArrayInputStream(data1),
            ds.getRecord(rec1.getIdentifier()).getStream());
        assertEquals(new ByteArrayInputStream(data3),
            ds.getRecord(rec3.getIdentifier()).getStream());
        ds.close();
    }

View Full Code Here

Examples of org.apache.jackrabbit.core.data.CachingDataStore

    /**
     * Test {@link DataStore#getAllIdentifiers()} and asserts all identifiers
     * are returned.
     */
    protected void doGetAllIdentifiersTest() throws Exception {
        CachingDataStore ds = createDataStore();
        List<DataIdentifier> list = new ArrayList<DataIdentifier>();
        Random random = new Random(12345);
        byte[] data = new byte[12345];
        random.nextBytes(data);
        DataRecord rec = ds.addRecord(new ByteArrayInputStream(data));
        list.add(rec.getIdentifier());


        data = new byte[12345];
        random.nextBytes(data);
        rec = ds.addRecord(new ByteArrayInputStream(data));
        list.add(rec.getIdentifier());


        data = new byte[12345];
        random.nextBytes(data);
        rec = ds.addRecord(new ByteArrayInputStream(data));
        list.add(rec.getIdentifier());


        Iterator<DataIdentifier> itr = ds.getAllIdentifiers();
        while (itr.hasNext()) {
            assertTrue("record found on list", list.remove(itr.next()));
        }
        assertEquals(0, list.size());
        ds.close();
    }

View Full Code Here

Examples of org.apache.jackrabbit.core.data.CachingDataStore

    /**
     * Asserts that timestamp of all records accessed after
     * {@link DataStore#updateModifiedDateOnAccess(long)} invocation.
     */
    protected void doUpdateLastModifiedOnAccessTest() throws Exception {
        CachingDataStore ds = createDataStore();
        Random random = new Random(12345);
        byte[] data = new byte[12345];
        random.nextBytes(data);
        DataRecord rec1 = ds.addRecord(new ByteArrayInputStream(data));


        data = new byte[12345];
        random.nextBytes(data);
        DataRecord rec2 = ds.addRecord(new ByteArrayInputStream(data));


        Thread.sleep(1000);
        long updateTime = System.currentTimeMillis();
        ds.updateModifiedDateOnAccess(updateTime);
        Thread.sleep(1000);
        data = new byte[12345];
        random.nextBytes(data);
        DataRecord rec3 = ds.addRecord(new ByteArrayInputStream(data));


        data = new byte[12345];
        random.nextBytes(data);
        DataRecord rec4 = ds.addRecord(new ByteArrayInputStream(data));


        rec1 = ds.getRecord(rec1.getIdentifier());


        assertEquals("rec1 touched", true,
            ds.getLastModified(rec1.getIdentifier()) > updateTime);
        assertEquals("rec2 not touched", true,
            ds.getLastModified(rec2.getIdentifier()) < updateTime);
        assertEquals("rec3 touched", true,
            ds.getLastModified(rec3.getIdentifier()) > updateTime);
        assertEquals("rec4 touched", true,
            ds.getLastModified(rec4.getIdentifier()) > updateTime);
        ds.close();


    }

View Full Code Here

0 1

TOP

All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.