Class CrawlerS3Target


  • public final class CrawlerS3Target
    extends java.lang.Object
    • Method Detail

      • connectionName

        public java.util.Optional<java.lang.String> connectionName()
        Returns:
        Name of a connection which allows crawler to access data in S3 within a VPC.
      • dlqEventQueueArn

        public java.util.Optional<java.lang.String> dlqEventQueueArn()
        Returns:
        ARN of the dead-letter SQS queue.
      • eventQueueArn

        public java.util.Optional<java.lang.String> eventQueueArn()
        Returns:
        ARN of the SQS queue to receive S3 notifications from.
      • exclusions

        public java.util.List<java.lang.String> exclusions()
        Returns:
        List of glob patterns used to exclude from the crawl.
      • path

        public java.lang.String path()
        Returns:
        Path to the Amazon S3 target.
      • sampleSize

        public java.util.Optional<java.lang.Integer> sampleSize()
        Returns:
        Sets the number of files in each leaf folder to be crawled when crawling sample files in a dataset. If not set, all the files are crawled. A valid value is an integer between 1 and 249.