Exploration on Micro Transformers, Unleash the power of mini-transformers!

Related tags

Admin Panels minitr
Overview

Mini Transformers

This is mainly for exploring on tiny transformers arch, experiement how to get a small while still powerful transformer architecture.

It was built upon detectron2. We plan to add some of these SOTA transformers based model:

  • DETR;
  • DINO;
  • DNDETR;

Some more models will be added.

Install

To install, please install detectron2 first, then:

python setup.py build develop

Demo

to be done.

Copyrights

All rights reserved by Lucas Jin @ 2022.

You might also like...

A blockchain based Tinder-like random art exploration responsive web app to discover and support lesser known artists.

A blockchain based Tinder-like random art exploration responsive web app to discover and support lesser known artists.

ArtLedger About A blockchain based Tinder-like random art exploration responsive web app to discover and support lesser known artists. This web app is

Mar 30, 2022

Exploration des data de l'évolution de l'épidémie de Coronavirus

Covid Explorer Exploration des data de l'évolution de l'épidémie de Coronavirus. Les datas sont mises à disposition par le Johns Hopkins Coronavirus R

May 9, 2022

A complete Instagram analysis and exploration tool from the desk of Mr. DSP.

Instalysis A complete Instagram analysis and exploration tool from the desk of Mr. DSP. Desclimer I am Darshan Ramjiyani not responsible for any uneth

May 10, 2022

A collection of the pytorch implementation of neural bandit algorithm includes neuralUCB(Neural Contextual Bandits with UCB-based Exploration) and neuralTS(Neural Thompson sampling)

A collection of the pytorch implementation of neural bandit algorithm includes neuralUCB(Neural Contextual Bandits with UCB-based Exploration) and neuralTS(Neural Thompson sampling)

Neural-Bandit Algorithms (NeuralUCB and NeuralTS) A collection of the pytorch implementation of neural bandit algorithm includes neuralUCB Neural Cont

Jun 30, 2022

A Python package for fast exploration of machine learning pipelines

A Python package for fast exploration of machine learning pipelines

Automated Tool for Optimized Modelling A Python package for fast exploration of machine learning pipelines 📜 Overview Mavs [email protected] Documen

Sep 9, 2022

HW Architecture-Mapping Design Space Exploration Framework for Deep Learning Accelerators

ZigZag-v2 This repository presents the novel version of our tried-and-tested HW Architecture-Mapping Design Space Exploration (DSE) Framework for Deep

Sep 15, 2022

Code for CIKM 2022 paper "A Preliminary Exploration of Extractive Multi-Document Summarization in Hyperbolic Space".

HyperSiameseNet This repository provides the code of the paper A Preliminary Exploration of Extractive Multi-Document Summarization in Hyperbolic Spac

Aug 22, 2022

Generating image from text prompt using DALLE-mini model.

DalleMini Generating image from text prompt using DALLE-mini model. Incoming Document must have .text filled. Returned image Documents are nested unde

May 2, 2022

An mini implementation of PointNet architecture for point cloud analysis and classification.

3DPointCloudDL A mini-project applying DL techniques to 3D point cloud data for classification and segmentation Background An implementation of PointN

May 27, 2022
Owner
JinTian
You know who I am.
JinTian
A mini python practice by creating a popular game (rock, paper scissors), if-else, array, and a while loop were used to created this mini project

rock_paper_scissors A mini python practice by creating a popular game (rock, paper scissors), if-else, array, and a while loop were used to created th

Adrienne Burney 1 Aug 12, 2022
A neural network based on the encoder-decoder architecture the modeling power of modern sequence models, Transformers with a set of promising experimental features from various papers.

Multi X Transformers A concise but fully-featured transformer, complete with a set of promising experimental features from various papers. Installatio

Muhammad Faris Adi Prabowo 2 Jul 27, 2022
Realtime micro-expression recognition using OpenCV and PyTorch

Micro-expression Recognition Realtime micro-expression recognition from scratch using OpenCV and PyTorch Try it out with a webcam or video using the e

Irfan 27 Sep 13, 2022
A small and robust micro Python framework for building simple and solid web apps.

LESPY Overview A small and robust micro Python framework for building simple and solid web apps. Quick start DEMO: You can see a working examples here

Natanael dos Santos Feitosa 1 Apr 28, 2022
This repository is created to document the codes developed to manipulate and extract features of micro CT scans of digital porous media.

Digital-Porous-Media-Micro-CT-Scans-Features-Exctraction This repository contains python codes used to muniulate and extract features from Mico CT sca

Mohamed Elmorsy 1 May 29, 2022
A micro-wrapper for Python cryptography

?? jcrypt A micro-wrapper for Python cryptography ?? About This is a micro-wrapper for the Python cryptography library. Intended for small projects, i

null 1 Jul 24, 2022
A collection of projects from the Micro:bit website but modified.

Microbit-Projects A collection of projects from the Micro:bit website but modified. Modifications Scissors, Paper, Rock You can choose scissors (pitch

AppleSheep 1 Aug 2, 2022
Source call for the paper "Mimicking the Annotation Process for Recognizing the Micro Expressions"

README Introduction This repo is the source code for the paper: "Mimicking the Annotation Process for Recognizing the Micro Expressions". Installation

Justin Ruan 2 Sep 4, 2022
Micro-serviço resposável por realizar a lógica relacionada a localidades do Schedula

gerenciador-de-localidades Micro-serviço responsável por realizar a lógica relacionada a localidades do Schedula Integrantes Matricula Membro Discipli

EPS/MDS 2 Aug 19, 2022
Extract code from Universal Hex files generated by the PXT-based Microsoft MakeCode IDE for micro:bit

bbc micro:bit PXT code extractor This project attempts to extract the code from so called Universal Hex files generated by the PXT-based Microsoft Mak

null 2 Aug 31, 2022