Simplify Data Conversion from Apache Spark to TensorFlow and PyTorch
( go to the article → https://databricks.com/blog/2020/06/16/simplify-data-conversion-from-apache-spark-to-tensorflow-and-pytorch.html )
Petastorm is a popular open-source library from Uber that enables single machine or distributed training and evaluation of deep learning models from datasets in Apache Parquet format. We are excited to announce that Petastorm 0.9.0 supports the easy conversion of data from Apache Spark DataFrame to TensorFlow Dataset and PyTorch DataLoader. The new Spark Dataset […] The post Simplify Data Conversion from Apache Spark to TensorFlow and PyTorch appeared first on Databricks.
June 16, 2020, 2 p.m.
You may be interested in:
Newest in: Deep Learning
Newest in: Spark
Newest in: Tensorflow