Guest User

Untitled

a guest
Aug 11th, 2014
320
0
Never
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
YAML 1.52 KB | None | 0 0
  1. :aws:
  2.   :access_key_id: XXX
  3.   :secret_access_key: XXXX
  4. :s3:
  5.   :region: eu-west-1 # S3 bucket region must be the same as Redshift cluster region
  6.   :buckets:
  7.     :jsonpath_assets: s3://mycompany-analytics/mycompany-json-schemas # If you have defined your own JSON Schemas, add the s3:// path to your own JSON Path files in your own bucket here
  8.     :enriched:
  9.       :good: s3://mycompany-analytics-out/snowplow-enriched/good # Must be s3:// not s3n:// for Redshift. This is the same as the :enriched:good: bucket specified for EmrEtlRunner
  10.       :archive: s3://mycompany-analytics-archive/snowplow-enriched # Where to archive enriched events to
  11.     :shredded:
  12.       :good: s3://mycompany-analytics-out/snowplow-shredded/good # Must be s3:// not s3n:// for Redshift. This is the same as the :shredded:good: bucket specified for EmrEtlRunner
  13.       :archive: s3://mycompany-analytics-archive/snowplow-shredded # Where to archive shredded types to
  14. :download:
  15.   :folder: # Not required for Redshift
  16. :targets:
  17.   - :name: "mycompany Redshift database"
  18.     :type: redshift
  19.     :host: mycompany-snowplow.ciaor1ldpfs.eu-west-1.redshift.amazonaws.com # The endpoint as shown in the Redshift console
  20.     :database: mycompany # Name of database
  21.     :port: 5439 # Default Redshift port
  22.     :table: atomic.events
  23.     :username: storageloader
  24.     :password: xxx
  25.     :maxerror: 1 # Stop loading on first error, or increase to permit more load errors
  26.     :comprows: 200000 # Default for a 1 XL node cluster. Not used unless --include compupdate specified
Advertisement
Add Comment
Please, Sign In to add comment