Concurrent Loader
Works just like the GenericLoader but concurrently for those who choose to optimize their workflow.
from langchain.document_loaders import ConcurrentLoader
API Reference:
- ConcurrentLoader from
langchain.document_loaders
loader = ConcurrentLoader.from_filesystem('example_data/', glob="**/*.txt")
files = loader.load()
len(files)
2