Sedona

`html

This document provides an overview of Apache Sedona and Mitsuba 3, two distinct projects focusing on spatial computing and rendering respectively. Apache Sedona is a powerful spatial computing engine for large-scale data analysis, while Mitsuba 3 is a research-oriented rendering system offering high performance and differentiability. Both projects offer extensive documentation and community support.

Join the community

Follow Sedona on Twitter for fresh news: Sedona@Twitter

Join the Sedona Discord community:

Join the Sedona monthly community office hour: Google Calendar, Tuesdays from 8 AM to 9 AM Pacific Time, every 4 weeks

Sedona JIRA: Bugs, Pull Requests, and other similar issues

Sedona Mailing Lists: [email protected]: project development, general questions or tutorials.

What is Apache Sedona?

Apache Sedona™ is a spatial computing engine that enables developers to easily process spatial data at any scale within modern cluster computing systems such as Apache Spark and Apache Flink.

Sedona developers can express their spatial data processing tasks in Spatial SQL, Spatial Python or Spatial R. Internally, Sedona provides spatial data loading, indexing, partitioning, and query processing/optimization functionality that enable users to efficiently analyze spatial data at any scale.

Features

Some of the key features of Apache Sedona include:

These are some of the key features of Apache Sedona, but it may offer additional capabilities depending on the specific version and configuration.

Click and play the interactive Sedona Python Jupyter Notebook immediately!

When to use Sedona?

Use Cases:

Apache Sedona is a widely used framework for working with spatial data, and it has many different use cases and applications. Some of the main use cases for Apache Sedona include:

Code Example:

This example loads NYC taxi trip records and taxi zone information stored as .CSV files on AWS S3 into Sedona spatial dataframes. It then performs spatial SQL query on the taxi trip datasets to filter out all records except those within the Manhattan area of New York. The example also shows a spatial join operation that matches taxi trip records to zones based on whether the taxi trip lies within the geographical extents of the zone. Finally, the last code snippet integrates the output of Sedona with GeoPandas and plots the spatial distribution of both datasets.

Load NYC taxi trips and taxi zones data from CSV Files Stored on AWS S3

Spatial SQL query to only return Taxi trips in Manhattan

Spatial Join between Taxi Dataframe and Zone Dataframe to Find taxis in each zone

Show a map of the loaded Spatial Dataframes using GeoPandas

Docker image

We provide a Docker image for Apache Sedona with Python JupyterLab and a single-node cluster. The images are available on DockerHub

Building Sedona

To install the Python package:

To compile the source code, please refer to Sedona website

Modules in the source code

Documentation

Please visit Apache Sedona website for detailed information

Powered by

example:

Mitsuba Renderer 3

Documentation	Tutorial videos	Linux	MacOS	Windows	PyPI

️

Warning

️

There currently is a large amount of undocumented and unstable work going on in

the master branch. We'd highly recommend you use our

latest release

until further notice.

If you already want to try out the upcoming changes, please have a look at

this porting guide.

It should cover most of the new features and breaking changes that are coming.

Introduction

Mitsuba 3 is a research-oriented rendering system for forward and inverse light

transport simulation developed at EPFL in Switzerland.

It consists of a core library and a set of plugins that implement functionality

ranging from materials and light sources to complete rendering algorithms.

Mitsuba 3 is retargetable: this means that the underlying implementations and

data structures can transform to accomplish various different tasks. For

example, the same code can simulate both scalar (classic one-ray-at-a-time) RGB transport

or differential spectral transport on the GPU. This all builds on

Dr.Jit, a specialized just-in-time(JIT) compiler developed specifically for this project.

Main Features

• Cross-platform: Mitsuba 3 has been tested on Linux (x86_64), macOS

  (aarch64, x8664), and Windows (x8664).

• High performance: The underlying Dr.Jit compiler fuses rendering code

  into kernels that achieve state-of-the-art performance using

  an LLVM backend targeting the CPU and a CUDA/OptiX backend

  targeting NVIDIA GPUs with ray tracing hardware acceleration.

• Python first: Mitsuba 3 is deeply integrated with Python. Materials,

  textures, and even full rendering algorithms can be developed in Python,

  which the system JIT-compiles (and optionally differentiates) on the fly.

  This enables the experimentation needed for research in computer graphics and

  other disciplines.

• Differentiation: Mitsuba 3 is a differentiable renderer, meaning that it

  can compute derivatives of the entire simulation with respect to input

  parameters such as camera pose, geometry, BSDFs, textures, and volumes. It

  implements recent differentiable rendering algorithms developed at EPFL.

• Spectral & Polarization: Mitsuba 3 can be used as a monochromatic

  renderer, RGB-based renderer, or spectral renderer. Each variant can

  optionally account for the effects of polarization if desired.

Tutorial videos, documentation

We've recorded several YouTube videos that provide a gentle introduction

Mitsuba 3 and Dr.Jit. Beyond this you can find complete Juypter notebooks

covering a variety of applications, how-to guides, and reference documentation

on readthedocs.

Installation

We provide pre-compiled binary wheels via PyPI. Installing Mitsuba this way is as simple as running

pip install mitsuba

on the command line. The Python package includes thirteen variants by default:

• scalar_rgb

• scalar_spectral

• scalarspectralpolarized

• llvmadrgb

• llvmadmono

• llvmadmono_polarized

• llvmadspectral

• llvmadspectral_polarized

• cudaadrgb

• cudaadmono

• cudaadmono_polarized

• cudaadspectral

• cudaadspectral_polarized

The first two perform classic one-ray-at-a-time simulation using either a RGB

or spectral color representation, while the latter two can be used for inverse

rendering on the CPU or GPU. To access additional variants, you will need to

compile a custom version of Dr.Jit using CMake. Please see the

documentation

for details on this.

Requirements

• Python >= 3.8

• (optional) For computation on the GPU: Nvidia driver >= 495.89

• (optional) For vectorized / parallel computation on the CPU: LLVM >= 11.1

Usage

Here is a simple "Hello World" example that shows how simple it is to render a

scene using Mitsuba 3 from Python:

# Import the library using the alias "mi"import mitsuba as mi# Set the variant of the renderermi.setvariant('scalarrgb')# Load a scenescene = mi.loaddict(mi.cornellbox())# Render the sceneimg = mi.render(scene)# Write the rendered image to an EXR filemi.Bitmap(img).write('cbox.exr')

Tutorials and example notebooks covering a variety of applications can be found

in the documentation.

About

This project was created by Wenzel Jakob.

Significant features and/or improvements to the code were contributed by

Sébastien Speierer,

Nicolas Roussel,

Merlin Nimier-David,

Delio Vicini,

Tizian Zeltner,

Baptiste Nicolet,

Miguel Crespo,

Vincent Leroy, and

Ziyi Zhang.

When using Mitsuba 3 in academic projects, please cite:

@software{Mitsuba3,title = {Mitsuba 3 renderer},author = {Wenzel Jakob and Sébastien Speierer and Nicolas Roussel and Merlin Nimier-David and Delio Vicini and Tizian Zeltner and Baptiste Nicolet and Miguel Crespo and Vincent Leroy and Ziyi Zhang},note = {https://mitsuba-renderer.org},version = {3.1.1},year = 2022}

`