public class DownloadJob extends TunnelJob
TunnelJob.FileFormat
bucketName, nullValue, objectPrefix, partCols, tblSchema
Constructor and Description |
---|
DownloadJob(Queue queue,
DownloadJobParam jobParam)
Create a download job to download data from DLI.
|
DownloadJob(Queue queue,
SQLJob job)
Create a download job to download query result
|
DownloadJob(Queue queue,
SQLJob job,
Integer limit)
Create a download job to download query result
|
DownloadJob(Queue queue,
String dbName,
String tblName)
Create a download job to download data from DLI.
|
DownloadJob(Queue queue,
String dbName,
String tblName,
BadRecordPolicy badRecordPolicy)
Deprecated.
|
DownloadJob(Queue queue,
String dbName,
String tblName,
List<String> partitionSpecs)
Create a download job to download data from DLI.
|
DownloadJob(Queue queue,
String dbName,
String tblName,
PartitionSpec partitionSpec)
Create a download job to download data from DLI.
|
DownloadJob(Queue queue,
String dbName,
String tblName,
PartitionSpec partitionSpec,
BadRecordPolicy badRecordPolicy)
Deprecated.
|
DownloadJob(Queue queue,
String dbName,
String tblName,
String partitionSpec) |
DownloadJob(Queue queue,
String dbName,
String tblName,
String partitionSpec,
BadRecordPolicy badRecordPolicy)
Deprecated.
|
Modifier and Type | Method and Description |
---|---|
Reader |
createReader() |
List<Reader> |
createReaders(int expectedMaxConcurrent)
Get readers to read data in concurrent, the reader num is calculate by DLI with the expectedMaxConcurrent,
that is the reader num is less or equal expectedMaxConcurrent if the data size is small.
|
String[] |
emptyRowValues() |
BadRecordPolicy |
getBadRecordPolicy() |
String |
getDownloadStatus() |
String |
getInternalJobId() |
long |
getResultCount() |
void |
setMaxCharsPerColumn(int maxCharsPerColumn)
Deprecated.
|
newRow, prepare, prepare, validPartSpec
public DownloadJob(Queue queue, SQLJob job) throws DLIException
queue
- the queue to running the download spark jobjob
- the query sql jobDLIException
- the exception if create download job failedpublic DownloadJob(Queue queue, SQLJob job, Integer limit) throws DLIException
queue
- the queue to running the download spark jobjob
- the query sql joblimit
- the limit number of download resultDLIException
- the exception if create download job failedpublic DownloadJob(Queue queue, DownloadJobParam jobParam) throws DLIException
queue
- the queue to running the download spark jobjobParam
- the job param include dbName, tableName,fileFormat,partitionsDLIException
- throw exception if create download job failedpublic DownloadJob(Queue queue, String dbName, String tblName) throws DLIException
queue
- the queue to running the download spark jobdbName
- the database name which the data to downloadtblName
- the table name which the data to downloadDLIException
- throw exception if create download job failedpublic DownloadJob(Queue queue, String dbName, String tblName, List<String> partitionSpecs) throws DLIException
queue
- the queue to running the download spark jobdbName
- the database name which the data to downloadtblName
- the table name which the data to downloadpartitionSpecs
- the multi partition spec for a partitioned tableDLIException
- throw exception if create download job failed@Deprecated public DownloadJob(Queue queue, String dbName, String tblName, BadRecordPolicy badRecordPolicy) throws DLIException
DLIException
public DownloadJob(Queue queue, String dbName, String tblName, String partitionSpec) throws DLIException
DLIException
@Deprecated public DownloadJob(Queue queue, String dbName, String tblName, String partitionSpec, BadRecordPolicy badRecordPolicy) throws DLIException
DLIException
public DownloadJob(Queue queue, String dbName, String tblName, PartitionSpec partitionSpec) throws DLIException
queue
- the queue to running the download spark jobdbName
- the database name which the data to downloadtblName
- the table name which the data to downloadpartitionSpec
- the partition spec for a partitioned tableDLIException
- throw exception if create download job failed@Deprecated public DownloadJob(Queue queue, String dbName, String tblName, PartitionSpec partitionSpec, BadRecordPolicy badRecordPolicy) throws DLIException
DLIException
public String[] emptyRowValues()
public BadRecordPolicy getBadRecordPolicy()
@Deprecated public void setMaxCharsPerColumn(int maxCharsPerColumn)
public Reader createReader() throws DLIException
DLIException
public List<Reader> createReaders(int expectedMaxConcurrent) throws DLIException
expectedMaxConcurrent
- the max concurrentDLIException
- the exception while create readerspublic String getInternalJobId() throws DLIException
DLIException
public String getDownloadStatus() throws DLIException
DLIException
public long getResultCount() throws DLIException
DLIException
Copyright © 2023. All rights reserved.