SlideShare a Scribd company logo
Image Pr Image Processing Application related with
VivIado ocessing Application related with
Vivado
Image Processing Application related
with Vivado
Dr.S.Shiyamala
Professor / ECE
Vel Tech Rangarajan Dr.Sagunthala R&D
Institute of Science and Technology
Chennai, TamilNadu.
FPGA
FPGA Architecture
FPGA Silicon View
FPGA – BRAM FEATURES
BRAM
Memory Types
Memory
Distributed
(MLUT-based)
Block RAM-based
(BRAM-based)
Inferred Instantiated
Memory
Manually Using Core Generator
FPGA Distributed
Memory
COUT
D Q
CK
S
R
EC
D Q
CK
R
EC
O
G4
G3
G2
G1
Look-Up
Table
Carry
&
Control
Logic
O
YB
Y
F4
F3
F2
F1
XB
X
Look-Up
Table
F5IN
BY
SR
S
Carry
&
Control
Logic
CIN
CLK
CE
SLICE
CLB Slice
16-bit SR
16 x 1 RAM
4-input LUT
The Design Warrior’s Guide to FPGAs
Devices, Tools, and Flows. ISBN 0750676043
Copyright © 2004 Mentor Graphics Corp. (www.mentor.com)
Xilinx Multipurpose LUT (MLUT)
16 x 1 ROM
(logic)
RAM16X1S
O
D
WE
WCLK
A0
A1
A2
A3
RAM32X1S
O
D
WE
WCLK
A0
A1
A2
A3
A4
RAM16X2S
O1
D0
WE
WCLK
A0
A1
A2
A3
D1
O0
=
=
LUT
LUT
or
LUT
RAM16X1D
SPO
D
WE
WCLK
A0
A1
A2
A3
DPRA0 DPO
DPRA1
DPRA2
DPRA3
or
Distributed RAM
• CLB LUT configurable as
Distributed RAM
– An LUT equals 16x1 RAM
– Cascade LUTs to increase RAM
size
• Synchronous write
• Asynchronous read
– Can create a synchronous read
by using extra flip-flops
– Naturally, distributed RAM read
is asynchronous
• Two LUTs can make
– 32 x 1 single-port RAM
– 16 x 2 single-port RAM
– 16 x 1 dual-port RAM
FPGA Block RAM
Block RAM
Spartan-3
Dual-Port
Block RAM
Port
A
Port
B
Block RAM
• Most efficient memory implementation
– Dedicated blocks of memory
• Ideal for most memory requirements
– 4 to 104 memory blocks
• 18 kbits = 18,432 bits per block (16 k without parity bits)
– Use multiple blocks for larger memories
• Builds both single and true dual-port RAMs
• Synchronous write and read (different from distributed
RAM)
BRAM
• Block RAMs (or BRAM) stands for Block
Random Access Memory.
• Block RAMs are used for storing large amounts
of data inside of your FPGA.
• A Block RAM (sometimes called embedded
memory, or Embedded Block RAM (EBR)), is a
discrete part of an FPGA, meaning there are
only so many of them available on the chip.
FIFO BRAM CONFIGURATION
DATA WIDTH OF BRAM
Generate the bitstream
(write_bitstream), and open the
implemented design
Run the script to generate MMI
(Memory Mapped Info file
Run updatemem to initialize the
BRAM with MEM data
Test on Hardware
CORE Generator
CORE Generator
BRAM Program sample
• module BMDEMO(
input clk,
input en,
input rst
);
wire [7:0]a,b;
wire [8:0]c;
reg [5:0]addr;
wire [8:0]bout;
blk_mem_gen_0 b1(clk,1'b0,addr,8'b1,a);
blk_mem_gen_0 b2(clk,1'b0,addr,8'b1,b);
adder a1 (a,b,c);
blk_mem_gen_1 b11(clk,1'b1,addr,c,bout);
• always @(posedge clk or negedge rst)
begin
if(!rst)
addr = {{6'b1}};
else if(en)
addr=addr+1;
else
addr=addr;
end
endmodule
module adder(a,b,c);
input [7:0]a,b;
output [8:0] c;
assign c = (a+b);
endmodule
Dr.s.shiyamala  fpga ppt
Dr.s.shiyamala  fpga ppt
Dr.s.shiyamala  fpga ppt
Dr.s.shiyamala  fpga ppt
Dr.s.shiyamala  fpga ppt
Dr.s.shiyamala  fpga ppt
BRAM USAGE
• Designers are encouraged to examine their
Virtex and ZYBO FPGA designs for surplus
block RAM and to use these functions to
unburden the FPGA logic.
• For example, using block RAM as state
machines simplifies the design effort,
significantly reduces routing overhead and
power consumption, and achieves higher
performance.
Real Time Image Application - Example
• FPGA implementation of high accuracy, low
latency breast cancer diagnosis using YOLO
algorithm
• FPGA implementation of CCSDS standard
DWT based hyper spectral image
decompression
Example 1
• FPGA implementation of high accuracy, low
latency breast cancer diagnosis using YOLO
algorithm
General schematic diagram of
mammographic data analysis using
FPGA
Data Base
• Some of the publicly available databases of the
mammogram and their descriptions are as
follows:
• MIAS Mini Mammographic Database (mini-MIAS)
• Digital Database for Screening Mammography
(DDSM)
• Mammographic Image Database for Automated
Analysis (MIDAS)
• Breast Cancer Digital Repository (BCDR)
Schematic representation of overall
methodology
Example of breast cancer image grid
and bounding box prediction for YOLO
Xilinx ZynqUltraScale+ MPSoC ZCU104 evaluation
FPGA board
(Equipment Details)
• Xilinx ZynqUltraScale+
MPSoC ZCU104 evaluation
FPGA board is most suitable
for this application.
• Hyperspectral image feed and
store in the FPGA BRAM
(Block RAM) in the .coe file
format.
• Xilinx VIVADO have in build
IP (Intellectual Property)
blocks.
Xilinx Vivado based YOLO architecture
IP Integrator
Example 2
• FPGA implementation of CCSDS standard DWT
based hyper spectral image decompression
Objectives
To design the smooth
interoperability and
adoption of compression
for the hyperspectral
image.
To develop low-
complexity high-
throughput algorithms is
used for encoding in
onboard and decoding in
ground station
To design the ease
efficient implementation
on space qualified
hardware using FPGA
General schematic diagram of hyperspectral
image compression using FPGA
Schematic Representation of overall
Methodology
Methodology
• Key constraints of the hyperspectral image decompressions are the high
volume of remote sensing data, limited storage resources, limited
downlink bandwidth and dynamic adaptability.
• High density and high-performance reconfigurable FPGA is the best
solution to overcome these problems. Lossless and hyper spectral image
compression follows the recommended standards CCSDS 123.0-B-2
(Consultative Committee for Space Data Systems) and CCSDS 121 is
for normal image only.
• Using multiplexer, have a chance to choose the required CCSDS
standard by using commands. More over CCSDS 123 standard supports
different scan orders for prediction and encoding, Band-Interleaved-by-
Pixel (BIP), Band-Interleaved-by-Line (BIL), Band-SeQuential (BSQ).
• JPEG (JP2) is an image compression standard and coding system which
is followed in CCSDS 123. To compress the image, Haar Discrete
Wavelet Transform is applied on it.
• Compressed images are encoded using MAP encoder and digital data
are transmitted. Decompress the image in ground station using inverse
Haar wavelet transform, to reconstruct the image without error.
• To enhance the efficiency of inverse Haar DWT, have an idea to replace
Specifications
• Spectral range - 400-1000 nm
• Number of spectral bands : up to 220
• Spectral resolution: 3nm
• Spectral Pixels : 800px X scan length
• Standard Lens : 16mm(200 FOV)
• Frame rate : upto 50 frames / sec
• Weight : ~ 570g (including standard lens)
• Dimension : (14 cm x 7 cm x 7 cm)
• Data format : Hyperspectral cube (ENVI-BSQ), Color
image
• (BMP), Band image (BMP), ROI spectra (CSV format)
OCI™-FHR
Hyperspectral Camera
Compression Technique
Haar Wavelet Transform
• Good approximation properties : Enables
applications of wavelet methods to digital
images: compression and progressive
transmission.
• Efficient way to compress the smooth data
except in localized region.
• Easy to control wavelet properties.( Example:
Smoothness, better accuracy near sharp
gradients)
• Allows information to be encoded according to
levels of detail.
• This layering facilitates approximations at
various intermediate stages requiring less space.
MAP
(Maximum A
Posteriori)
decoder
General diagram for Convolutional encoder with
K = 5 and code rate ½
Thank you
THANK YOU

More Related Content

What's hot (20)

PPTX
ASIC DESIGN : PLACEMENT
helloactiva
 
PPT
SOC design
Vinchipsytm Vlsitraining
 
PPT
FPGA
Abhilash Nair
 
PDF
Soc architecture and design
Satya Harish
 
PPTX
Implementation strategies for digital ics
aroosa khan
 
PPTX
Fpga
bharadwajareddy
 
PDF
fpga programming
Anish Gupta
 
PPT
Design and development of carry select adder
ABIN THOMAS
 
PPTX
4.FPGA for dummies: Design Flow
Maurizio Donna
 
PPTX
Slideshare - PCIe
Jin Wu
 
DOCX
Intellectual property in vlsi
Saransh Choudhary
 
PPT
Vlsi technology-dinesh
dinesh kumar
 
PPT
VLSI routing
Naveen Kumar
 
PDF
Sram pdf
S. S. Dhakad Dhakad
 
PPT
Fundamentals of FPGA
velamakuri
 
PPTX
Adder
anuppatel111
 
PDF
DRAM Cell - Working and Read and Write Operations
Naman Bhalla
 
ASIC DESIGN : PLACEMENT
helloactiva
 
Soc architecture and design
Satya Harish
 
Implementation strategies for digital ics
aroosa khan
 
fpga programming
Anish Gupta
 
Design and development of carry select adder
ABIN THOMAS
 
4.FPGA for dummies: Design Flow
Maurizio Donna
 
Slideshare - PCIe
Jin Wu
 
Intellectual property in vlsi
Saransh Choudhary
 
Vlsi technology-dinesh
dinesh kumar
 
VLSI routing
Naveen Kumar
 
Fundamentals of FPGA
velamakuri
 
Adder
anuppatel111
 
DRAM Cell - Working and Read and Write Operations
Naman Bhalla
 

Similar to Dr.s.shiyamala fpga ppt (20)

PDF
“Addressing Evolving AI Model Challenges Through Memory and Storage,” a Prese...
Edge AI and Vision Alliance
 
PPT
FPGA_prototyping proccesing with conclusion
PersiPersi1
 
PPT
Multi Processor Architecture for image processing
ideas2ignite
 
PDF
Imaging automotive 2015 addfor v002
Enrico Busto
 
PDF
Imaging automotive 2015 addfor v002
Enrico Busto
 
PDF
Moving object detection on FPGA
Sundance Multiprocessor Technology Ltd.
 
PDF
“The Importance of Memory for Breaking the Edge AI Performance Bottleneck,” a...
Edge AI and Vision Alliance
 
PDF
“Programming Vision Pipelines on AMD’s AI Engines,” a Presentation from AMD
Edge AI and Vision Alliance
 
DOC
yeong_wang_resume_Jan_2015
Yeong Wang
 
PDF
SDVIs and In-Situ Visualization on TACC's Stampede
Intel® Software
 
PPTX
Introduction to FPGA acceleration
Marco77328
 
PDF
Capturing and Displaying Digital Image
Integrated Circuit Design Research & Education Center (ICDREC)
 
PPTX
GPU Design on FPGA
Ramanathan SG
 
PPT
POLYTEDA PowerDRC/LVS overview
Alexander Grudanov
 
PDF
26_Fan.pdf
RioCarthiis
 
PPTX
Gpu with cuda architecture
Dhaval Kaneria
 
PDF
IMAGE CAPTURE, PROCESSING AND TRANSFER VIA ETHERNET UNDER CONTROL OF MATLAB G...
Christopher Diamantopoulos
 
DOC
Resume_Bhasker
bhasker esarapu
 
PPT
Multiprocessor Architecture for Image Processing
mayank.grd
 
PPT
Semiconductor overview
Nabil Chouba
 
“Addressing Evolving AI Model Challenges Through Memory and Storage,” a Prese...
Edge AI and Vision Alliance
 
FPGA_prototyping proccesing with conclusion
PersiPersi1
 
Multi Processor Architecture for image processing
ideas2ignite
 
Imaging automotive 2015 addfor v002
Enrico Busto
 
Imaging automotive 2015 addfor v002
Enrico Busto
 
Moving object detection on FPGA
Sundance Multiprocessor Technology Ltd.
 
“The Importance of Memory for Breaking the Edge AI Performance Bottleneck,” a...
Edge AI and Vision Alliance
 
“Programming Vision Pipelines on AMD’s AI Engines,” a Presentation from AMD
Edge AI and Vision Alliance
 
yeong_wang_resume_Jan_2015
Yeong Wang
 
SDVIs and In-Situ Visualization on TACC's Stampede
Intel® Software
 
Introduction to FPGA acceleration
Marco77328
 
GPU Design on FPGA
Ramanathan SG
 
POLYTEDA PowerDRC/LVS overview
Alexander Grudanov
 
26_Fan.pdf
RioCarthiis
 
Gpu with cuda architecture
Dhaval Kaneria
 
IMAGE CAPTURE, PROCESSING AND TRANSFER VIA ETHERNET UNDER CONTROL OF MATLAB G...
Christopher Diamantopoulos
 
Resume_Bhasker
bhasker esarapu
 
Multiprocessor Architecture for Image Processing
mayank.grd
 
Semiconductor overview
Nabil Chouba
 
Ad

Recently uploaded (20)

PPTX
Information Retrieval and Extraction - Module 7
premSankar19
 
PDF
2010_Book_EnvironmentalBioengineering (1).pdf
EmilianoRodriguezTll
 
PDF
AI-Driven IoT-Enabled UAV Inspection Framework for Predictive Maintenance and...
ijcncjournal019
 
PPTX
Inventory management chapter in automation and robotics.
atisht0104
 
PDF
settlement FOR FOUNDATION ENGINEERS.pdf
Endalkazene
 
PDF
All chapters of Strength of materials.ppt
girmabiniyam1234
 
PPTX
ENSA_Module_7.pptx_wide_area_network_concepts
RanaMukherjee24
 
DOCX
SAR - EEEfdfdsdasdsdasdasdasdasdasdasdasda.docx
Kanimozhi676285
 
PPTX
filteration _ pre.pptx 11111110001.pptx
awasthivaibhav825
 
PDF
Air -Powered Car PPT by ER. SHRESTH SUDHIR KOKNE.pdf
SHRESTHKOKNE
 
PPTX
MULTI LEVEL DATA TRACKING USING COOJA.pptx
dollysharma12ab
 
PDF
Introduction to Ship Engine Room Systems.pdf
Mahmoud Moghtaderi
 
PPTX
IoT_Smart_Agriculture_Presentations.pptx
poojakumari696707
 
PDF
Jual GPS Geodetik CHCNAV i93 IMU-RTK Lanjutan dengan Survei Visual
Budi Minds
 
PDF
EVS+PRESENTATIONS EVS+PRESENTATIONS like
saiyedaqib429
 
PDF
Biodegradable Plastics: Innovations and Market Potential (www.kiu.ac.ug)
publication11
 
PPTX
Ground improvement techniques-DEWATERING
DivakarSai4
 
PDF
67243-Cooling and Heating & Calculation.pdf
DHAKA POLYTECHNIC
 
PPTX
Chapter_Seven_Construction_Reliability_Elective_III_Msc CM
SubashKumarBhattarai
 
PPTX
Precedence and Associativity in C prog. language
Mahendra Dheer
 
Information Retrieval and Extraction - Module 7
premSankar19
 
2010_Book_EnvironmentalBioengineering (1).pdf
EmilianoRodriguezTll
 
AI-Driven IoT-Enabled UAV Inspection Framework for Predictive Maintenance and...
ijcncjournal019
 
Inventory management chapter in automation and robotics.
atisht0104
 
settlement FOR FOUNDATION ENGINEERS.pdf
Endalkazene
 
All chapters of Strength of materials.ppt
girmabiniyam1234
 
ENSA_Module_7.pptx_wide_area_network_concepts
RanaMukherjee24
 
SAR - EEEfdfdsdasdsdasdasdasdasdasdasdasda.docx
Kanimozhi676285
 
filteration _ pre.pptx 11111110001.pptx
awasthivaibhav825
 
Air -Powered Car PPT by ER. SHRESTH SUDHIR KOKNE.pdf
SHRESTHKOKNE
 
MULTI LEVEL DATA TRACKING USING COOJA.pptx
dollysharma12ab
 
Introduction to Ship Engine Room Systems.pdf
Mahmoud Moghtaderi
 
IoT_Smart_Agriculture_Presentations.pptx
poojakumari696707
 
Jual GPS Geodetik CHCNAV i93 IMU-RTK Lanjutan dengan Survei Visual
Budi Minds
 
EVS+PRESENTATIONS EVS+PRESENTATIONS like
saiyedaqib429
 
Biodegradable Plastics: Innovations and Market Potential (www.kiu.ac.ug)
publication11
 
Ground improvement techniques-DEWATERING
DivakarSai4
 
67243-Cooling and Heating & Calculation.pdf
DHAKA POLYTECHNIC
 
Chapter_Seven_Construction_Reliability_Elective_III_Msc CM
SubashKumarBhattarai
 
Precedence and Associativity in C prog. language
Mahendra Dheer
 
Ad

Dr.s.shiyamala fpga ppt

  • 1. Image Pr Image Processing Application related with VivIado ocessing Application related with Vivado Image Processing Application related with Vivado Dr.S.Shiyamala Professor / ECE Vel Tech Rangarajan Dr.Sagunthala R&D Institute of Science and Technology Chennai, TamilNadu.
  • 5. FPGA – BRAM FEATURES
  • 10. 16-bit SR 16 x 1 RAM 4-input LUT The Design Warrior’s Guide to FPGAs Devices, Tools, and Flows. ISBN 0750676043 Copyright © 2004 Mentor Graphics Corp. (www.mentor.com) Xilinx Multipurpose LUT (MLUT) 16 x 1 ROM (logic)
  • 11. RAM16X1S O D WE WCLK A0 A1 A2 A3 RAM32X1S O D WE WCLK A0 A1 A2 A3 A4 RAM16X2S O1 D0 WE WCLK A0 A1 A2 A3 D1 O0 = = LUT LUT or LUT RAM16X1D SPO D WE WCLK A0 A1 A2 A3 DPRA0 DPO DPRA1 DPRA2 DPRA3 or Distributed RAM • CLB LUT configurable as Distributed RAM – An LUT equals 16x1 RAM – Cascade LUTs to increase RAM size • Synchronous write • Asynchronous read – Can create a synchronous read by using extra flip-flops – Naturally, distributed RAM read is asynchronous • Two LUTs can make – 32 x 1 single-port RAM – 16 x 2 single-port RAM – 16 x 1 dual-port RAM
  • 13. Block RAM Spartan-3 Dual-Port Block RAM Port A Port B Block RAM • Most efficient memory implementation – Dedicated blocks of memory • Ideal for most memory requirements – 4 to 104 memory blocks • 18 kbits = 18,432 bits per block (16 k without parity bits) – Use multiple blocks for larger memories • Builds both single and true dual-port RAMs • Synchronous write and read (different from distributed RAM)
  • 14. BRAM • Block RAMs (or BRAM) stands for Block Random Access Memory. • Block RAMs are used for storing large amounts of data inside of your FPGA. • A Block RAM (sometimes called embedded memory, or Embedded Block RAM (EBR)), is a discrete part of an FPGA, meaning there are only so many of them available on the chip.
  • 17. Generate the bitstream (write_bitstream), and open the implemented design Run the script to generate MMI (Memory Mapped Info file Run updatemem to initialize the BRAM with MEM data Test on Hardware
  • 20. BRAM Program sample • module BMDEMO( input clk, input en, input rst ); wire [7:0]a,b; wire [8:0]c; reg [5:0]addr; wire [8:0]bout; blk_mem_gen_0 b1(clk,1'b0,addr,8'b1,a); blk_mem_gen_0 b2(clk,1'b0,addr,8'b1,b); adder a1 (a,b,c); blk_mem_gen_1 b11(clk,1'b1,addr,c,bout);
  • 21. • always @(posedge clk or negedge rst) begin if(!rst) addr = {{6'b1}}; else if(en) addr=addr+1; else addr=addr; end endmodule module adder(a,b,c); input [7:0]a,b; output [8:0] c; assign c = (a+b); endmodule
  • 28. BRAM USAGE • Designers are encouraged to examine their Virtex and ZYBO FPGA designs for surplus block RAM and to use these functions to unburden the FPGA logic. • For example, using block RAM as state machines simplifies the design effort, significantly reduces routing overhead and power consumption, and achieves higher performance.
  • 29. Real Time Image Application - Example • FPGA implementation of high accuracy, low latency breast cancer diagnosis using YOLO algorithm • FPGA implementation of CCSDS standard DWT based hyper spectral image decompression
  • 30. Example 1 • FPGA implementation of high accuracy, low latency breast cancer diagnosis using YOLO algorithm
  • 31. General schematic diagram of mammographic data analysis using FPGA
  • 32. Data Base • Some of the publicly available databases of the mammogram and their descriptions are as follows: • MIAS Mini Mammographic Database (mini-MIAS) • Digital Database for Screening Mammography (DDSM) • Mammographic Image Database for Automated Analysis (MIDAS) • Breast Cancer Digital Repository (BCDR)
  • 33. Schematic representation of overall methodology
  • 34. Example of breast cancer image grid and bounding box prediction for YOLO
  • 35. Xilinx ZynqUltraScale+ MPSoC ZCU104 evaluation FPGA board (Equipment Details) • Xilinx ZynqUltraScale+ MPSoC ZCU104 evaluation FPGA board is most suitable for this application. • Hyperspectral image feed and store in the FPGA BRAM (Block RAM) in the .coe file format. • Xilinx VIVADO have in build IP (Intellectual Property) blocks.
  • 36. Xilinx Vivado based YOLO architecture
  • 38. Example 2 • FPGA implementation of CCSDS standard DWT based hyper spectral image decompression
  • 39. Objectives To design the smooth interoperability and adoption of compression for the hyperspectral image. To develop low- complexity high- throughput algorithms is used for encoding in onboard and decoding in ground station To design the ease efficient implementation on space qualified hardware using FPGA
  • 40. General schematic diagram of hyperspectral image compression using FPGA
  • 41. Schematic Representation of overall Methodology
  • 42. Methodology • Key constraints of the hyperspectral image decompressions are the high volume of remote sensing data, limited storage resources, limited downlink bandwidth and dynamic adaptability. • High density and high-performance reconfigurable FPGA is the best solution to overcome these problems. Lossless and hyper spectral image compression follows the recommended standards CCSDS 123.0-B-2 (Consultative Committee for Space Data Systems) and CCSDS 121 is for normal image only. • Using multiplexer, have a chance to choose the required CCSDS standard by using commands. More over CCSDS 123 standard supports different scan orders for prediction and encoding, Band-Interleaved-by- Pixel (BIP), Band-Interleaved-by-Line (BIL), Band-SeQuential (BSQ). • JPEG (JP2) is an image compression standard and coding system which is followed in CCSDS 123. To compress the image, Haar Discrete Wavelet Transform is applied on it. • Compressed images are encoded using MAP encoder and digital data are transmitted. Decompress the image in ground station using inverse Haar wavelet transform, to reconstruct the image without error. • To enhance the efficiency of inverse Haar DWT, have an idea to replace
  • 43. Specifications • Spectral range - 400-1000 nm • Number of spectral bands : up to 220 • Spectral resolution: 3nm • Spectral Pixels : 800px X scan length • Standard Lens : 16mm(200 FOV) • Frame rate : upto 50 frames / sec • Weight : ~ 570g (including standard lens) • Dimension : (14 cm x 7 cm x 7 cm) • Data format : Hyperspectral cube (ENVI-BSQ), Color image • (BMP), Band image (BMP), ROI spectra (CSV format) OCI™-FHR Hyperspectral Camera
  • 45. Haar Wavelet Transform • Good approximation properties : Enables applications of wavelet methods to digital images: compression and progressive transmission. • Efficient way to compress the smooth data except in localized region. • Easy to control wavelet properties.( Example: Smoothness, better accuracy near sharp gradients) • Allows information to be encoded according to levels of detail. • This layering facilitates approximations at various intermediate stages requiring less space.
  • 47. General diagram for Convolutional encoder with K = 5 and code rate ½