iwafu

name	iwafu
description	Platform rules, Taiwan relevance gate, false-positive filters, and troubleshooting for the iwafu scraper
applyTo	scraper/sources/iwafu.py

iwafu Scraper — Platform Reference

Platform Profile

Field	Value
Site URL	https://www.iwafu.com
Search URL	https://www.iwafu.com/jp/events?keyword=台湾&prefecture=東京
Rendering	JS-heavy — requires Playwright (sync_playwright)
Auth required	No
Rate limit	Implicit (no hard throttle; add 0.5 s between detail pages)
Source name	iwafu
Source ID format	iwafu_{numeric_id} (extracted from /jp/events/{id})

Field Mappings

Event Field	iwafu Source
source_id	iwafu_{numeric_id} from URL path (stable)
raw_title	<h1> on detail page
start_date	_parse_date() from card date range, confirmed on detail page
end_date	End of date range on card; falls back to start_date if single-day
location_name	場所[：:]\s*(.+?) from main_text; fallback: card.prefecture
location_address	Same value as location_name (set both)
raw_description	Detail page main.inner_text(), trimmed at first _NOISE_MARKER

Taiwan Relevance Gate

All events are fetched with keyword=台湾 — iwafu applies the search server-side. However a second relevance check is mandatory because iwafu search results can include:

• Global / nationwide tour events where Taiwan is merely one stop.
• IP entertainment series (escape rooms, anime tie-ins) that visit Taiwan venues.

Global-tour false positive

Reject if description matches _GLOBAL_TOUR_PATTERNS:

_GLOBAL_TOUR_PATTERNS = re.compile(
    r"台湾など世界各地|台湾など.*各地|全国各地.*台湾|世界各地.*台湾|台湾.*世界各地"
    r"|全国[0-9０-９]+[都道府県施設箇所].*台湾|台湾.*全国[0-9０-９]",
    re.DOTALL,
)

Taiwan must be the theme or primary focus, not just one venue.

Title-level block (_BLOCKED_TITLE_PATTERNS)

Known IP series where all events are non-Taiwan-themed:

_BLOCKED_TITLE_PATTERNS = re.compile(
    r"リアル脱出ゲーム.*名探偵コナン|名探偵コナン.*リアル脱出ゲーム"
    r"|名探偵コナン.*脱出|脱出.*名探偵コナン",
)

Check card title before loading the detail page (fast reject by card title, saves Playwright loads).

Permanent series block (_BLOCKED_SERIES)

IP series where every event is confirmed non-Taiwan-themed. Checked on BOTH card title AND <h1> on detail page (card titles can be truncated).

_BLOCKED_SERIES = re.compile(
    r"名探偵コナン",  # All Conan events — confirmed global-tour non-Taiwan-themed
)

Add new series entries here when an IP is confirmed.

Location Extraction

• Primary: regex 場所[：:]\s*(.+?)(?:\n|交通手段|Q&A|https?://|$) on main_text.
• Set both location_name and location_address to the captured value.
• Fallback: card.prefecture (e.g. "東京") — only when 場所： label is absent.
• Never store bare prefecture names as location_address — they will be flagged by backfill_locations.py.

Address Regex Rules（_ADDR_RE）

_ADDR_RE は以下のパターンで日本の住所を抽出する：

_ADDR_RE = re.compile(
    r'(?:〒\d{3}-\d{4}\s*\n?\s*)?'
    r'(?:(?:東京都|北海道|(?:大阪|京都)府|.{2,5}[都道府県])\s*)?'  # optional prefecture
    r'(?:[^\s（(]{1,4}[市区町村])'                               # required city/ward
    r'.{1,30}?[0-9０-９]+(?:[-ー―][0-9０-９]+)+'
)

重要：都道府縣は optional。日本の住所は都道府縣を省略して市区町村から始まることが多い（例: 渋谷区〇〇1-2-3）。[市区町村] の suffix が唯一の必須 anchor。

Official Site Body Text Fallback（official_body_text）

iwafu 本文（main_text）で住所が見つからない場合、official site の body text をフォールバックとして使用する：

1. _fetch_official_organizer_info(page, official_url) は 3-tuple を返す： (organizer, supplemental_text, body_text)
2. body_text は公式サイトの全テキスト（page.inner_text("body")）
3. main_text で _ADDR_RE がマッチしない場合のみ、official_body_text を検索する（追加 Playwright フェッチなし）

addr_m = _ADDR_RE.search(main_text)
if addr_m is None and official_body_text:
    addr_m = _ADDR_RE.search(official_body_text)

注意： _fetch_official_organizer_info の戻り値は 3-tuple。呼び出し元は必ず 3 つの変数で受け取ること：

official_organizer, official_credits_text, official_body_text = (
    _fetch_official_organizer_info(page, official_url)
)

Description Trimming

_NOISE_MARKERS defines UI section headers that signal the start of noise content. Trim raw_description at the first occurrence of any marker (ordered list, first match wins):

_NOISE_MARKERS = (
    "Q&A イベントについて",
    "近くの看板",
    "近くのイベント",
    "地図検索に切り替えて",
)

DB Audit Rule

After adding a new filter (blocking pattern or series entry):

1. Run ilike("raw_title", "%keyword%") on the events table to find existing records.
2. Hard-delete or deactivate them — the filter only prevents future inserts.
3. Prefer hard-delete (table.delete().eq("id", eid)) for permanently non-Taiwan-themed series.

Pending Rules