



        I have a Node that has been off-line for over 3 hours, this is outside the
        Hinted Hand-off window.
        
        
        This node is out of sync w/ the other copies of the records it is hosting
        
        it needs to be fixed...
        
        We offer Read Repair.
        
        
        When I do do a Read command w/ CL=ALL the coordinator will compare 
        the timestamps for each column in each copy, and updated the out of date 
        copies w/ the copy having the latest timestamp
        
        read Repairs happens when the appl does a read w/ CL=ALL
        OR (maybe) when the appl does any other read 
        10% of the time Read Repair will run on NON CL=ALL 
           within the local DataCenter
        0% of the time Read Repair will run on NON CL=ALL 
           outside the local DataCenter   
           
           
        ----------------------------------------
        
        to fix an out-of-sync node:
        
        1) Read Repair, if you read the record 
            this will fix a single record at time
        2) nodetool repair
            this will fix the entire node
        3) Node Sync
            will run a background Read Repair on chunks of the records
        
        
     CREATE TABLE customers (
         first_name text, 
         last_name text,
         company_name text,
         address text,
         city text,
         county text,
         state text,
         zip int,
         phone1 text,
         phone2 text,
         email text,
         web text,
         PRIMARY KEY ((state), city, last_name, first_name))
           WITH nodesync = {'enabled' : 'true'}    <= note this line
        )        
        
        
