Get All Pricing Data

Download all CSV files from a DTN FTP directory and parse them into pricing data records.

Operation

getAllFiles

Resource

file

Parameters

Parameter	Type	Required	Default	Description
Path	string	No	/	The directory path to download files from

Options

Option	Type	Default	Description
Recursive	boolean	true	Whether to search for files recursively in subdirectories
Include Debug Info	boolean	false	Whether to include metadata about the source file

Response

Success

Returns an array of parsed pricing records from all CSV files:

{
  "product": "Propane",
  "terminal": "Dallas Terminal",
  "price": 1.25,
  "effectiveDate": "2024-01-15",
  "supplier": "ABC Energy"
}

With debug info enabled:

{
  "product": "Propane",
  "terminal": "Dallas Terminal",
  "price": 1.25,
  "effectiveDate": "2024-01-15",
  "supplier": "ABC Energy",
  "_source": {
    "fileName": "pricing_2024-01-15.csv",
    "filePath": "/data/pricing_2024-01-15.csv",
    "fileSize": 15420
  }
}

Error

{
  "success": false,
  "error": "Connection refused",
  "path": "/"
}

Behavior

1. Lists all files in the specified directory (recursively by default)
2. Downloads only .csv files
3. Parses each CSV file into individual records
4. Returns all records as separate output items

Error Handling

• Missing Host: DTN credential is missing host
• Connection Failure: Unable to connect to FTP server
• Invalid Path: Directory path does not exist
• Parse Errors: CSV parsing errors are included in error output