1  # Etherscan Source
 2  
 3  ## Usage
 4  
 5  This Airbyte connector extracts data from the Etherscan API.
 6  
 7  - `WalletTransactions` -  Etherscan **Transactions** tab
 8  - `WalletInternalTransactions` - Etherscan **Internal Transactions** tab
 9  - `WalletTokenTransactions` - Etherscan **Token Transfers (ERC-20)** tab
10  - `MinedBlocks` - Etherscan **Beacon Chain > Produced Blocks** tab
11  - `BeaconWithdrawals` - Etherscan **Beacon Chain > Withdrawals** tab
12  - `NativeBalance` - `ETH` balance as in the **Overview**
13  - `TokenBalance` - ERC-20 token balance as in **TOKEN HOLDINGS**
14  
15  ## Data Backfill
16  
17  To fetch all of the transactions and beacon chain data from the beginning, you must:
18  
19  1. Set the `backfill` config variable to `True`
20  2. Delete / drop the Airbyte tables and schema (**Optional**)
21  3. Make sure that the Sync mode is `Full refresh | Append` mode, instead of `Full refresh | Overwrite`. **Overwrite** will cause the streams to run in parallel instead of sequentially.
22  
23  ## Local development
24  
25  ### Prerequisites
26  
27  From this connector directory, create a virtual environment:
28  ```
29  python -m venv .venv
30  source .venv/bin/activate
31  pip install -r requirements.txt
32  ```
33  
34  ### Locally running the connector
35  ```bash
36  poetry run source-etherscan spec
37  poetry run source-etherscan check --config secrets/config.json
38  poetry run source-etherscan discover --config secrets/config.json
39  poetry run source-etherscan read --config secrets/config.json --catalog sample_files/configured_catalog.json
40  ```
41  
42  ### Locally running the connector docker image
43  
44  ```bash
45  docker build -t airbyte/source-etherscan:dev .
46  # Running the spec command against your patched connector
47  docker run airbyte/source-etherscan:dev spec
48  ```
49  
50  #### Run
51  Then run any of the connector commands as follows:
52  ```bash
53  docker run --rm airbyte/source-etherscan:dev spec
54  docker run --rm -v $(pwd)/secrets:/secrets airbyte/source-etherscan:dev check --config /secrets/config.json
55  docker run --rm -v $(pwd)/secrets:/secrets airbyte/source-etherscan:dev discover --config /secrets/config.json
56  docker run --rm -v $(pwd)/secrets:/secrets -v $(pwd)/sample_files:/sample_files airbyte/source-etherscan:dev read --config /secrets/config.json --catalog /sample_files/configured_catalog.json
57  ```