Package | Description |
---|---|
com.huawei.dli.sdk |
Modifier and Type | Class and Description |
---|---|
class |
AvroObsReader
Read avro file from OBS, the avro files are generated by Spark.
|
class |
JsonObsReader |
class |
ObsReader |
Modifier and Type | Method and Description |
---|---|
Reader |
DownloadJob.createReader() |
Reader |
SQLJob.exportResult()
Export QUEUE type job result with a iterator
|
Reader |
SQLJob.exportResult(Integer limit) |
Modifier and Type | Method and Description |
---|---|
List<Reader> |
DownloadJob.createReaders(int expectedMaxConcurrent)
Get readers to read data in concurrent, the reader num is calculate by DLI with the expectedMaxConcurrent,
that is the reader num is less or equal expectedMaxConcurrent if the data size is small.
|
Copyright © 2023. All rights reserved.