> For the complete documentation index, see [llms.txt](https://lwang010.gitbook.io/longw/llms.txt). Markdown versions of documentation pages are available by appending `.md` to page URLs; this page is available as [Markdown](https://lwang010.gitbook.io/longw/dataops/etl/tips.md).

# Tips

1\. Set all non-numerical columns to json format. (different data type; potential space/blank issue for splits etc)

2\. Test with the mini case, but use as much assert and try-except as possible to capture as much corner cases as possible.

3\. Also check if the record number is consistent.