Transcript 下載/瀏覽Download

Interactive E-Learning System
Using Pattern Recognition and
Augmented Reality
Sang Hwa Lee, Junyeong Choi, and Jong-Il Park, Member, IEEE
報告者：謝宏偉
大綱
•
•
•
•
前言
研究目的
研究方法
結果
前言
• This paper proposes an interactive e-learning
system using pattern recognition and augmented
reality.
• The proposed e-learning system augments the
audio-visual contents as the students interact
with the objects in the textbook.
研究目的
• The proposed e-learning system consists of
image/object recognition, polka-dot pattern
recognition, color-band marker recognition,
augmented reality engine, audio-visual contents,
and some learning scenarios of textbooks.
• The scenarios combine the educational contents
with information technologies to maximize the
learning efficiency. And the augmented reality
engine realizes the scenarios.
研究目的
研究方法
• We design two markers using polka-dot pattern
or color-band.
• The markers are put on the fingers as bands, and
act like the computer mouse.
• The markers indicate their locations in the video
frame, which enables the students to interact
according to the objects in the textbook.
研究方法
• 1. Polka-dot Pattern Recognition
• We exploit the polka-dot marker for interactive
augmentation of contents and menu selection.
研究方法
• 2. Color-band Recognition
• Some interactions in the educational scenarios
require two or more markers simultaneously to
manipulate multiple objects.
• Since the polka-dot patterns have little distinct
difference between them, it is difficult to operate
the multiple markers independently.
研究方法
研究方法
• 3. RECOGNITION OF IMAGE AND
OBJECT
• Image recognition is designed for identification
of current text page or objects.
• When the text page or objects are identified, the
related audio-visual contents are automatically
played on the PC.
研究方法
• A.Feature Extraction
• In the scale space structure, the point at x and σ
is the distinct feature point, if the determinant
value is largest in the 26 neighbors.
研究方法
• B. Feature Matching
RANSAC匹配除錯
研究方法
• C. Image and Object Recognition
研究方法
結果
結果
• This interactive augment reality made the
students have more interest in learning.
• Therefore, the proposed e-leaning system not
only provides with audio-visual contents, but
also improves the learning efficiency and
concentration of students.
謝謝聆聽!