Канал: WestDRI

Intro to the Alliance Cloud

Intro to the Alliance Cloud

Distributed file storage with git-annex

Distributed file storage with git-annex

Nextflow and Julia for scalable computation

Nextflow and Julia for scalable computation

Lazygit

Lazygit

Best practices in HPC/HTC environments

Best practices in HPC/HTC environments

GPU computing with Chapel

GPU computing with Chapel

Understanding Emacs modes

Understanding Emacs modes

DataFrames on steroids with Polars

DataFrames on steroids with Polars

Julia at full tilt: profiling and optimizations

Julia at full tilt: profiling and optimizations

Lossy data compression

Lossy data compression

JAX: a framework for high-performance array computing

JAX: a framework for high-performance array computing

Things researchers should know before using Generative AI

Things researchers should know before using Generative AI

Modern Emacs: all those new tools that make Emacs better and faster

Modern Emacs: all those new tools that make Emacs better and faster

Photogrammetry on HPC clusters

Photogrammetry on HPC clusters

AI-powered coding with GitHub Copilot

AI-powered coding with GitHub Copilot

Command-line image processing with ImageMagick

Command-line image processing with ImageMagick

Version control for data science and machine learning with DVC

Version control for data science and machine learning with DVC

Text analysis in 3D

Text analysis in 3D

Emacs as a programming IDE for Python, R, and Julia

Emacs as a programming IDE for Python, R, and Julia

Essentials of HPC for new users: A practical example using hydrological models

Essentials of HPC for new users: A practical example using hydrological models

Image-based approach to large-scale visualization

Image-based approach to large-scale visualization

A map of current machine learning frameworks

A map of current machine learning frameworks

Launching 2023 Visualize This contest

Launching 2023 Visualize This contest

NDVI test animation

NDVI test animation

Simulation of a storm over Eastern Canada

Simulation of a storm over Eastern Canada

Managing large hierarchical datasets with PyTables

Managing large hierarchical datasets with PyTables

Learning Regular Expressions with Smart Tools

Learning Regular Expressions with Smart Tools

The new R Markdown: authoring dynamic scientific documents with Quarto

The new R Markdown: authoring dynamic scientific documents with Quarto

Distributed datasets with DataLad

Distributed datasets with DataLad

Automating the GROMACS analysis tools on HPC systems

Automating the GROMACS analysis tools on HPC systems

How to create and access MySQL and PostgreSQL databases on DRI systems

How to create and access MySQL and PostgreSQL databases on DRI systems

Data management with DataLad

Data management with DataLad

Introduction to high-performance research computing in R

Introduction to high-performance research computing in R

Hiding large numbers of files in container overlays

Hiding large numbers of files in container overlays

Lesser known but very useful Bash features

Lesser known but very useful Bash features

Turbo boost your interactive experience on the cluster with tmux

Turbo boost your interactive experience on the cluster with tmux

Data visualization in Julia with the Makie ecosystem

Data visualization in Julia with the Makie ecosystem

TensorBoard for objection detection models

TensorBoard for objection detection models

In-situ visualization with ParaView Catalyst2

In-situ visualization with ParaView Catalyst2

Best practices for securing your own OpenStack VM / Amazon instances / Containers

Best practices for securing your own OpenStack VM / Amazon instances / Containers

A few of our favourite tools

A few of our favourite tools

ThreadsX.jl: easier multithreading in Julia

ThreadsX.jl: easier multithreading in Julia

Everything you wanted to know (and more) about PyTorch tensors

Everything you wanted to know (and more) about PyTorch tensors

Installing software using EasyBuild in your cluster home directory

Installing software using EasyBuild in your cluster home directory

WestGrid Town Hall - November 26, 2021

WestGrid Town Hall - November 26, 2021

Upscaling with PyTorch

Upscaling with PyTorch

Highlights from the 2021 SciVis Contest

Highlights from the 2021 SciVis Contest

Easier parallel Julia workflow with Dagger.jl

Easier parallel Julia workflow with Dagger.jl

Best Practices 2022

Best Practices 2022

Container-based approach to bioinformatics applications

Container-based approach to bioinformatics applications

Remote visualization on Compute Canada clusters

Remote visualization on Compute Canada clusters

Using Singularity containers in VMs and HPC webinar by WestGrid

Using Singularity containers in VMs and HPC webinar by WestGrid

Exploration of tools and approaches for Humanists webinar by WestGrid

Exploration of tools and approaches for Humanists webinar by WestGrid

Scientific visualization on NVIDIA GPUs

Scientific visualization on NVIDIA GPUs

Introduction to deep learning with fastai webinar by WestGrid

Introduction to deep learning with fastai webinar by WestGrid

Clusterstats

Clusterstats

Parallel Julia webinar

Parallel Julia webinar

Linking databases to code repositories with Throughput

Linking databases to code repositories with Throughput

Automating your backups in Linux and MacOS

Automating your backups in Linux and MacOS

WestGrid Town Hall - February 5, 2021

WestGrid Town Hall - February 5, 2021

Advanced GIS mapping in R

Advanced GIS mapping in R

Workflows with Programmable Filter & Source in ParaView

Workflows with Programmable Filter & Source in ParaView

WestGrid December 2020 Community Town Hall

WestGrid December 2020 Community Town Hall

Basics of GIS mapping in R

Basics of GIS mapping in R

SciVis Contest 2021: Earth’s Mantle Convection

SciVis Contest 2021: Earth’s Mantle Convection

The Topology Toolkit

The Topology Toolkit

So, you are stuck with your code … now what?

So, you are stuck with your code … now what?

Intermediate VMD topics - Trajectories, movies, scripting

Intermediate VMD topics - Trajectories, movies, scripting

Working with multidimensional datasets in xarray

Working with multidimensional datasets in xarray

RAC 2021 best practices

RAC 2021 best practices

WestGrid June 2020 Community Town Hall

WestGrid June 2020 Community Town Hall

WestGrid Introduction - This is WestGrid

WestGrid Introduction - This is WestGrid

Docker exercise 4

Docker exercise 4

Docker exercise 3

Docker exercise 3

Docker exercise 2

Docker exercise 2

Docker exercise 1

Docker exercise 1

Second part

Second part

How to use MariaDB on Cedar

How to use MariaDB on Cedar

Learning further about basic SQL

Learning further about basic SQL

Quick overview about database servers

Quick overview about database servers

Create programs and Slurm jobs that connect to the database

Create programs and Slurm jobs that connect to the database

If you need help to connect to Cedar via SSH from Windows

If you need help to connect to Cedar via SSH from Windows

Create programs and Slurm jobs that connect to the database

Create programs and Slurm jobs that connect to the database

Queries on Cedar and Exercises

Queries on Cedar and Exercises

Introduction to MySQL on Cedar

Introduction to MySQL on Cedar

Basic commands and SQL queries

Basic commands and SQL queries

How to use Postgres on Cedar

How to use Postgres on Cedar

Using fzf with Git

Using fzf with Git

Git basics

Git basics

Gromacs simulation optimization

Gromacs simulation optimization

Mining Twitter data for research: Part 2

Mining Twitter data for research: Part 2

Small remote visualization demo

Small remote visualization demo

Large remote visualization demo

Large remote visualization demo

Rendering on cluster GPUs

Rendering on cluster GPUs

Summary

Summary

Scripted camera animation

Scripted camera animation

Remote visualization

Remote visualization

Programmable filter

Programmable filter

Intro to ParaView scripting

Intro to ParaView scripting

Web-based 3D scientific visualization

Web-based 3D scientific visualization

Machine learning in Julia with Flux

Machine learning in Julia with Flux

Julia REPL

Julia REPL

Animation View

Animation View

Other techniques

Other techniques

Online visualization

Online visualization

Line integral convolution

Line integral convolution

CSV data

CSV data

Better streamlines

Better streamlines

Visualizing vectors

Visualizing vectors

Side-by-side visualization

Side-by-side visualization

State files

State files

Working with filters

Working with filters

Scientific file formats

Scientific file formats

Intro and legacy VTK

Intro and legacy VTK

XML VTK

XML VTK

File formats and reading raw binary

File formats and reading raw binary

Running paraview

Running paraview

Multi-dimensional sci-vis

Multi-dimensional sci-vis

Plotly hands-on

Plotly hands-on

1D/2D plotting

1D/2D plotting

Basic concepts

Basic concepts

Best practices and summary

Best practices and summary

Getting information and other Slurm commands

Getting information and other Slurm commands

Interactive jobs

Interactive jobs

Hybrid and GPU jobs

Hybrid and GPU jobs

Slurm jobs and memory

Slurm jobs and memory

Building software on Compute Canada clusters using EasyBuild

Building software on Compute Canada clusters using EasyBuild

WestGrid April 2020 Community Town Hall

WestGrid April 2020 Community Town Hall

Slurm intro

Slurm intro

Shared-memory jobs

Shared-memory jobs

MPI jobs

MPI jobs

Serial jobs

Serial jobs

Core equivalents

Core equivalents

Python and R on clusters

Python and R on clusters

Make build automation tool

Make build automation tool

Other essential tools

Other essential tools

Python Dask

Python Dask

Programming languages and tools

Programming languages and tools

Chapel parallel programming language

Chapel parallel programming language

MPI (message passing interface)

MPI (message passing interface)

Basic tools on HPC clusters

Basic tools on HPC clusters

Remote file transfer

Remote file transfer

Cluster hardware overview

Cluster hardware overview

OpenMP

OpenMP

Introduction to HPC intro

Introduction to HPC intro

Getting Started in the Compute Canada Cloud

Getting Started in the Compute Canada Cloud

Scientific graphics with gnuplot

Scientific graphics with gnuplot

Getting help in bash

Getting help in bash

Navigating directories in bash

Navigating directories in bash

Fuzzy finder

Fuzzy finder

Text processing with awk

Text processing with awk

Text manipulation in bash

Text manipulation in bash

Combining find and grep

Combining find and grep

Finding files with find

Finding files with find

Bash functions

Bash functions

Grep search in files

Grep search in files

Bash variables

Bash variables

Script example in molecules

Script example in molecules

Shell scripts in bash

Shell scripts in bash

Bash loops

Bash loops

Wildcards, redirection to files, and pipes in bash

Wildcards, redirection to files, and pipes in bash

Transferring files and folders with scp

Transferring files and folders with scp

Working with archives and compression in bash

Working with archives and compression in bash

Moving and copying things in bash

Moving and copying things in bash

Creating things in bash

Creating things in bash

Working with data files and external C libraries in Chapel

Working with data files and external C libraries in Chapel

High-performance research computing with Julia

High-performance research computing with Julia

Fun tools to simplify your life in the command line

Fun tools to simplify your life in the command line

Singularity in High Performance Computing (HPC)

Singularity in High Performance Computing (HPC)

WestGrid January 2020 Community Town Hall

WestGrid January 2020 Community Town Hall

WestGrid December 2019 Community Town Hall

WestGrid December 2019 Community Town Hall

Geospatial analysis with high performance computing

Geospatial analysis with high performance computing

Photorealistic rendering with ParaView and OSPRay

Photorealistic rendering with ParaView and OSPRay

Mining Twitter data for research: Part 1

Mining Twitter data for research: Part 1

Setting up a bioinformatics QC pipeline

Setting up a bioinformatics QC pipeline

File access control: Approaches and best practices

File access control: Approaches and best practices

Working with the Python DASK library

Working with the Python DASK library

WestGrid September 2019 Community Town Hall

WestGrid September 2019 Community Town Hall

Batch visualization on Compute Canada clusters

Batch visualization on Compute Canada clusters

WestGrid May 2019 Community Town Hall

WestGrid May 2019 Community Town Hall

Managing many files with Disk ARchiver (DAR)

Managing many files with Disk ARchiver (DAR)

Working with distributed unstructured data in Chapel

Working with distributed unstructured data in Chapel

Short Read Mapping: The foundation of next generation sequencing analysis

Short Read Mapping: The foundation of next generation sequencing analysis

Using Valgrind: Free Tools for Memory Management and Debugging

Using Valgrind: Free Tools for Memory Management and Debugging

Introduction to Research Data Management

Introduction to Research Data Management

Molecular visualization with VMD

Molecular visualization with VMD

Text parsing and matching with HPC resources

Text parsing and matching with HPC resources

WestGrid March 1, 2019 Community Town Hall

WestGrid March 1, 2019 Community Town Hall

Working with data objects in yt

Working with data objects in yt

WestGrid Community Town Hall - December 2018

WestGrid Community Town Hall - December 2018

How to deploy HTTP & HTTPS sites on the Compute Canada Cloud

How to deploy HTTP & HTTPS sites on the Compute Canada Cloud

Intro to Using Chapel for Parallel Programming: Part 1

Intro to Using Chapel for Parallel Programming: Part 1

Getting started in the Compute Canada Cloud

Getting started in the Compute Canada Cloud

Using yt for analysis & visualization of volumetric data

Using yt for analysis & visualization of volumetric data

How HPC helped researchers simulate the life of a star

How HPC helped researchers simulate the life of a star

WestGrid Community Town Hall - November 2, 2018

WestGrid Community Town Hall - November 2, 2018

Data Analytics & Machine Learning with MATLAB

Data Analytics & Machine Learning with MATLAB

Tools for automating analysis pipelines

Tools for automating analysis pipelines

How to deal with common scheduling problems when using Compute Canada systems

How to deal with common scheduling problems when using Compute Canada systems

Arbutus Upgrade: What you need to know

Arbutus Upgrade: What you need to know