模組:Data consistency check
此模块檢查維基詞典上使用的語言、語言系屬和文字数据模块的有效性和內部一致性:包括Category:語言資料模块 和 Module:scripts/data。
輸出[编辑]
檢測到差異:
Template:langname-lite
- 代碼:
aek
。現有名稱:Haeke。預期名稱:哈克語。 - 代碼:
aey
。現有名稱:Amele。預期名稱:阿梅勒語。 - 代碼:
anw
。現有名稱:Anaang。預期名稱:阿納昂語。 - 代碼:
apl
。現有名稱:Lipan。預期名稱:利攀語。 - 代碼:
aqg
。現有名稱:Arigidi。預期名稱:阿里吉蒂語。 - 代碼:
bnq
。現有名稱:Bantik。預期名稱:班第語。 - 代碼:
byt
。現有名稱:Berti。預期名稱:扎加瓦語。 - 代碼:
clc
。現有名稱:Chilcotin。預期名稱:奇爾科廷語。 - 代碼:
dis
。現有名稱:Dimasa。預期名稱:迪馬薩語。 - 代碼:
eee
。現有名稱:E。預期名稱:誒話。 - 代碼:
emb
。現有名稱:Embaloh。預期名稱:恩巴洛語。 - 代碼:
fad
。現有名稱:Wagi。預期名稱:瓦吉語。 - 代碼:
hdy
。現有名稱:Hadiyya。預期名稱:哈迪亞語。 - 代碼:
hro
。現有名稱:Haroi。預期名稱:赫雷語。 - 代碼:
huu
。現有名稱:穆瑞胡圖圖語。預期名稱:穆魯伊維托托語。 - 代碼:
jaz
。現有名稱:Jawe。預期名稱:賈韋語。 - 代碼:
lew
。現有名稱:Ledo Kaili。預期名稱:列多-凱利語。 - 代碼:
mbj
。現有名稱:Nadëb。預期名稱:納德布語。 - 代碼:
mee
。現有名稱:Mengen。預期名稱:門根語。 - 代碼:
mps
。現有名稱:Dadibi。預期名稱:達迪比語。 - 代碼:
nag
。現有名稱:Naga Pidgin。預期名稱:那加克里奧爾語。 - 代碼:
pml
。現有名稱:Sabir。預期名稱:沙比爾語。 - 代碼:
ppk
。現有名稱:烏馬語。預期名稱:烏瑪語。 - 代碼:
qsb-ibe
。現有名稱:a pre-Roman substrate of Iberia。預期名稱:羅馬佔領前一種伊比利亞底層語言。 - 代碼:
rel
。現有名稱:Rendille。預期名稱:倫迪勒語。 - 代碼:
slu
。現有名稱:Selaru。預期名稱:塞拉魯語。 - 代碼:
snp
。現有名稱:Siane。預期名稱:西亞內語。 - 代碼:
tmu
。現有名稱:Iau。預期名稱:雅烏語。 - 代碼:
ugo
。現有名稱:貢語。預期名稱:貢語 (泰國)。 - 代碼:
und-phi
。現有名稱:Philistine。預期名稱:非利士語。 - 代碼:
xrn
。現有名稱:Arin。預期名稱:阿林語。
Module:etymology languages/data
- The data key
preprocess_links
for ??? (th-new
) is invalid. - 赫爾尼基語 (
xum-her
) has a canonical name that is not unique; it is also used by the codexhr
.
Module:families/data
- Phla–Pherá是
alv-pph
的名稱,但在aliases
中重複出現。 - 古印度-雅利安語支 (
inc-old
) has no child families or languages. - 普拉克里特諸語言 (
pra
) has no child families or languages.
Module:languages/data/2
- 書面挪威語 (
nb
) has 中古挪威語 (gmq-mno
) set as an ancestor, but is not in the 西斯堪地那維亞語支 (gmq-wes
). - 書面挪威語 (
nb
) has 丹麥語 (da
) set as an ancestor, but is not in the 東斯堪地那維亞語支 (gmq-eas
). - ??? (
zh
) lists an invalid script codeHants
.
Module:languages/data/3/a
- ??? (
aeu
) 的規範名稱不唯一,同時被代碼aik
使用。 - ??? (
aic
) 的規範名稱不唯一,同時被代碼amk
使用。 - ??? (
alh
) 的規範名稱不唯一,同時被代碼aru
使用。
Module:languages/data/3/b
- ??? (
bfy
) 的規範名稱不唯一,同時被代碼bgq
使用。 - ??? (
bgw
) 的規範名稱不唯一,同時被代碼btv
使用。 - ??? (
bhb
) 的規範名稱不唯一,同時被代碼bzr
使用。 - ??? (
boa
) 的規範名稱不唯一,同時被代碼bxd
使用。 - ??? (
bsq
) 的規範名稱不唯一,同時被代碼bas
使用。 - ??? (
bzw
) 的規範名稱不唯一,同時被代碼bas
使用。
Module:languages/data/3/c
- ??? (
cdo
) lists an invalid script codeHants
. - ??? (
cjy
) lists an invalid script codeHants
. - Maa是
cma
的名稱,但在aliases
中重複出現。 - ??? (
cmn
) lists an invalid script codeHants
. - ??? (
cnp
) lists an invalid script codeHants
. - ??? (
cpx
) lists an invalid script codeHants
. - Island Carib是
crb
的名稱,但在otherNames
中重複出現。 - ??? (
csp
) lists an invalid script codeHants
. - ??? (
czh
) lists an invalid script codeHants
. - ??? (
czo
) lists an invalid script codeHants
.
Module:languages/data/3/d
- ??? (
dax
) 的規範名稱不唯一,同時被代碼dij
使用。 - ??? (
dng
) lists an invalid script codeHants
.
Module:languages/data/3/g
- ??? (
gan
) lists an invalid script codeHants
.
Module:languages/data/3/h
- ??? (
hak
) lists an invalid script codeHants
. - 加勒比印度斯坦語 (
hns
) has 阿瓦德語 (awa
) set as an ancestor, but is not in the 東印地語支 (inc-hie
). - 加勒比印度斯坦語 (
hns
) has 博杰普爾語 (bho
) set as an ancestor, but is not in the 東印度-雅利安語支 (inc-eas
). - ??? (
hsn
) lists an invalid script codeHants
.
Module:languages/data/3/k
- ??? (
keh
) 的規範名稱不唯一,同時被代碼kzq
使用。 - ??? (
klm
) 的規範名稱不唯一,同時被代碼kyo
使用。 - ??? (
kmg
) 的規範名稱不唯一,同時被代碼ket
使用。 - ??? (
kmx
) 的規範名稱不唯一,同時被代碼aup
使用。 - ??? (
koz
) 的規範名稱不唯一,同時被代碼hhr
使用。 - ??? (
kvc
) 的規範名稱不唯一,同時被代碼kqb
使用。
Module:languages/data/3/l
- Looma是
lom
的名稱,但在otherNames
中重複出現。
Module:languages/data/3/m
- ??? (
mmq
) 的規範名稱不唯一,同時被代碼ahs
使用。 - ??? (
mmr
) 的規範名稱不唯一,同時被代碼muq
使用。 - ??? (
mnk
) 的規範名稱不唯一,同時被代碼man
使用。 - ??? (
mnp
) lists an invalid script codeHants
. - ??? (
mui
) 的規範名稱不唯一,同時被代碼mse
使用。
Module:languages/data/3/n
- ??? (
nan
) lists an invalid script codeHants
. - ??? (
nev
) 的規範名稱不唯一,同時被代碼hnu
使用。
Module:languages/data/3/o
- Adivasi Oriya是
ort
的名稱,但在aliases
中重複出現。
Module:languages/data/3/p
- ??? (
pbv
) 的規範名稱不唯一,同時被代碼bvn
使用。 - ??? (
pht
) 的規範名稱不唯一,同時被代碼mfl
使用。 - ??? (
ppt
) 的規範名稱不唯一,同時被代碼pai
使用。
Module:languages/data/3/r
- ??? (
rwo
) 的規範名稱不唯一,同時被代碼luf
使用。
Module:languages/data/3/s
- ??? (
snx
) 的規範名稱不唯一,同時被代碼raq
使用。
Module:languages/data/3/t
- ??? (
tiv
) 的規範名稱不唯一,同時被代碼ter
使用。
Module:languages/data/3/v
- ??? (
vmw
) 的規範名稱不唯一,同時被代碼lva
使用。
Module:languages/data/3/w
- Wè Northern是
wob
的名稱,但在otherNames
中重複出現。 - ??? (
wuu
) lists an invalid script codeHants
. - ??? (
wxa
) lists an invalid script codeHants
.
Module:languages/data/3/x
- ??? (
xcr
) 的規範名稱不唯一,同時被代碼khr
使用。 - ??? (
xns
) 的規範名稱不唯一,同時被代碼soq
使用。
Module:languages/data/3/y
- Yaroamë是
yro
的名稱,但在otherNames
中重複出現。 - ??? (
yue
) lists an invalid script codeHants
.
Module:languages/data/exceptional
- ??? (
nan-hbl
) lists an invalid script codeHants
. - ??? (
nan-hnm
) lists an invalid script codeHants
. - ??? (
nan-luh
) lists an invalid script codeHants
. - ??? (
nan-tws
) lists an invalid script codeHants
. - ??? (
tuw-bal
) 的規範名稱不唯一,同時被代碼bao
使用。 - ??? (
zhx-sht
) lists an invalid script codeHants
. - ??? (
zhx-sic
) lists an invalid script codeHants
. - ??? (
zhx-tai
) lists an invalid script codeHants
.
Module:languages/data/exceptional/extra
- ??? (
map-kxv
) has data in Module:languages/data/exceptional, but does not have corresponding data in Module:languages/data/exceptional/extra. - ??? (
map-trv
) has data in Module:languages/data/exceptional, but does not have corresponding data in Module:languages/data/exceptional/extra.
Module:scripts/data
- 布列斯符號(
Blis
)未被任何語言使用並且沒有給出供自動檢測所用的字元。 - 塞普勒斯-米諾斯文字(
Cpmn
)未被任何語言使用。 - 平假名(
Hira
)未被任何語言使用。 - 假名(
Hrkt
)未被任何語言使用。 - 圖像渲染(
Imag
)未被任何語言使用並且沒有給出供自動檢測所用的字元。 - 國際音標(
Ipach
)未被任何語言使用並且沒有給出供自動檢測所用的字元。 - Moon(
Moon
)未被任何語言使用並且沒有給出供自動檢測所用的字元。 - 摩斯電碼(
Morse
)未被任何語言使用並且沒有給出供自動檢測所用的字元。 - 音樂記號(
Music
)未被任何語言使用。 - 未指定文字(
None
)未被任何語言使用並且沒有給出供自動檢測所用的字元。 - Ol Onal(
Onao
)未被任何語言使用並且沒有給出供自動檢測所用的字元。 - 朗格朗格(
Roro
)未被任何語言使用並且沒有給出供自動檢測所用的字元。 - 盧米文數字(
Rumin
)未被任何語言使用。 - 旗語(
Semap
)未被任何語言使用並且沒有給出供自動檢測所用的字元。 - Visible Speech(
Visp
)未被任何語言使用並且沒有給出供自動檢測所用的字元。 - 數學記號(
Zmth
)未被任何語言使用。 - 符號(
Zsym
)未被任何語言使用。 - 未定文字(
Zyyy
)未被任何語言使用並且沒有給出供自動檢測所用的字元。 - 未編碼文字(
Zzzz
)未被任何語言使用並且沒有給出供自動檢測所用的字元。 - The data key
sort_by_scraping
for 日文 (Jpan
) is invalid.
進行的檢查[编辑]
對於多個数据模块:
- 語言、語言系屬和詞源語言的代碼必須是唯一的,不能相互衝突。
- 不得在其他名稱列表中找到語言、語言系屬和詞源語言的規範名稱。
- 其他名稱列表中的每個名稱只能出現一次。
otherNames
如果存在,則必須是一個数组。- 維基數據項 ID 必須是正整數,或者以
Q
開頭、以十進位數字結尾的字符串。
Module:languages 使用的數據必須滿足以下條件:
- Each code must be defined in the correct submodule according to whether it is two-letter, three-letter or exceptional.
- The canonical name (field
1
) must be present and must not be the same as the canonical name of another language. - If field
2
is notnil
, it must a valid Wikidata item ID. - If field
3
orfamily
is given and notnil
, it must be a valid family code. - If field
4
orscripts
is given and notnil
, it must be an array, and each string in the array must be a valid script code. - If
ancestors
is given, it must be an array, and each string in the array must be a valid language or etymology language code. - If
family
is given, it must be a valid family code. - If
type
is given, it must be one of the recognised values (regular
,reconstructed
,appendix-constructed
). - If
entry_name
is given, it must be a table that contains either two arrays (from
andto
) or a string (remove_diacritics
) or both. - If
sort_key
is given, it may either be a string, or at table that in turn contains either two arrays (from
andto
) or a string (remove_diacritics
). - If
entry_name
orsort_key
is given, thefrom
array must be longer or equal in length to theto
array. - If
standardChars
is given, it must form a valid Lua string pattern when placed between square brackets with^
before it ("[^...]
). (It should match all characters regularly used in the language, but that cannot be tested.) - If
override_translit
is set,translit
must also be set, because there must be a transliteration module that can override manual transliteration. - If
link_tr
is present, it must betrue
. - Have no data keys besides these:
1, 2, 3, "entry_name", "sort_key", "display", "otherNames", "aliases", "varieties", "type", "scripts", "ancestors", "wikimedia_codes", "wikipedia_article", "standardChars", "translit", "override_translit", "link_tr"
.
未執行的檢查:
- If
translit
is present, it should be the name of a module, and this module should contain atr
function that takes a pagename (and optionally a language code and script code) as arguments. - If
sort_key
is a string, it should be the name of a module, and this module should contain amakeSortKey
function that takes a pagename (and optionally a language code and script code) as arguments. - If
entry_name
orsort_key
is a table and contains a fieldremove_diacritics
, the value of the field should be a string that forms a valid Lua pattern when it is placed inside negated set notation ([^...]
).
此模块沒有檢查這些項目,因為如果不滿足以上條件,模块錯誤將很快出現在條目中(如Module:utilities 嘗試為與該語言相關的分類生成排序鍵,或者full_link
嘗試使用音譯模塊等)。
Module:languages/code to canonical name 和 Module:languages/canonical names 必須包含且僅應包含 Module:languages 的数据子模块中的所有代碼和規範名稱。
Module:etymology languages 使用的数据必須滿足以下條件:
- 必須給出
canonicalName
。 parent
必須給出,且必須是有效的語言、語言系屬或詞源語言的代碼。- If
ancestors
is given, it must be an array, and each string in the array must be a valid language or etymology language code. The etymology language should also be listed as the ancestor of a regular language. - Have no data keys besides these:
"canonicalName", "otherNames", "parent", "ancestors", "wikipedia_article", "wikidata_item"
.
Module:families 中的代碼数据必須:
- Have
canonicalName
, which must not be the same as the canonical name of another family. - If
family
is given, it must be a valid family code. - Have at least one language or subfamily belonging to it.
- Have no data keys besides these:
"canonicalName", "otherNames", "family", "protoLanguage", "wikidata_item"
.
Module:scripts 中的代碼数据必須:
- Have
canonicalName
. - Have at least one language that lists it as one of its scripts.
- Have a
characters
pattern for script autodetection, and this must form a valid Lua string pattern when placed between square brackets ("[...]"
). (It should match all characters in the script, but that cannot be tested.) - Have no data keys besides these:
"canonicalName", "otherNames", "parent", "systems", "wikipedia_article", "characters", "direction"
.
local split = mw.text.split
local export = {}
local m_language_data = require("Module:languages/data/all")
local m_language_codes = require("Module:languages/code to canonical name")
local m_language_canonical_names = require("Module:languages/canonical names")
local m_etym_language_data = require("Module:etymology languages/data")
local m_etym_language_codes = require("Module:etymology languages/code to canonical name")
local m_etym_language_canonical_names = require("Module:etymology languages/canonical names")
local m_family_data = require("Module:families/data")
local m_family_codes = require("Module:families/code to canonical name")
local m_family_canonical_names = require("Module:families/canonical names")
local m_script_data = require("Module:scripts/data")
local m_languages = require("Module:languages")
local m_links = require("Module:links")
local m_scripts = require("Module:scripts")
local m_script_utils = require("Module:script utilities")
local m_table = require("Module:table")
local Array = require("Module:array")
local messages
local function discrepancy(modname, ...)
local ok, result = pcall(function(...) messages[modname]:insert(string.format(...)) end, ...)
if not ok then
mw.log(result, ...)
end
end
local all_codes = {}
local language_names = {}
local family_names = {}
local script_names = {}
local nonempty_families = {}
local allowed_empty_families = {tbq = true}
local nonempty_scripts = {}
do
local function link_lang(name)
return "[[:Category:" .. name .. "|" .. name .. "]]"
end
local function link_etym_lang(name)
return name
end
local function link_family(name)
return "[[:Category:" .. name .. "|" .. name .. "]]"
end
function export.link(data)
if not data[1] then
return "???"
end
local type = data.type
return type:match("etymology%-only") and link_etym_lang(data[1]) or
type:match("family") and link_family(data[1]) or
link_lang(data[1])
end
end
local link = export.link
local function link_script(name)
if not name then
return "???"
else
return "[[:Category:" .. name .. "|" .. name .. "]]"
end
end
local function invalid_keys_message(modname, code, data, invalid_keys, is_script)
local plural = #invalid_keys ~= 1
discrepancy(modname, "The data key%s %s for %s (<code>%s</code>) %s invalid.",
plural and "s" or "",
invalid_keys
:map(
function(key)
return '<code>' .. key .. '</code>'
end)
:concat(", "),
(is_script and link_script or link)(data[1]),
code,
plural and "are" or "is")
end
local function check_data_keys(valid_keys, is_script)
valid_keys = Array(valid_keys):to_set()
return function (modname, code, data)
local invalid_keys
for k in pairs(data) do
if not valid_keys[k] then
invalid_keys = invalid_keys or Array()
invalid_keys:insert(k)
end
end
if invalid_keys then
invalid_keys_message(modname, code, data, invalid_keys, is_script)
end
end
end
-- Modification of isArray in [[Module:table]].
local function find_gap(t)
local i = 0
for _ in pairs(t) do
i = i + 1
if t[i] == nil then
return i
end
end
end
local function check_true_or_nil(modname, code, data, field_name)
if not (data[field_name] == nil or data[field_name] == true) then
discrepancy(modname,
"%s (<code>%s</code>) has an <code>%s</code> value that is not <code>nil</code> or <code>true</code>: %s",
link(canonical_name), code, field_name,
tostring(data.link_tr)
)
end
end
local function check_array(modname, code, data, array_name, subarray_name)
local subtable = data
if subarray_name then
subtable = assert(data[subarray_name], subarray_name)
end
local array_type = type(subtable[array_name])
if array_type == "table" then
local gap = find_gap(subtable[array_name])
if gap then
discrepancy(modname, "The %s array in %sthe data table for %s (<code>%s</code>) has a gap at index %d.",
array_name,
subarray_name and "the " .. subarray_name .. " field in " or "",
data[1],
code, gap)
else
return true
end
else
discrepancy(modname, "The %s field in %sthe data table for %s (<code>%s</code>) should be an array (table) but is %s.",
array_name,
subarray_name and "the " .. subarray_name .. " field in " or "",
data[1],
code,
array_type == "nil" and "nil" or "a " .. array_type)
end
end
local function check_wikidata_item(modname, code, data, key)
local data_item = data[key]
if data_item == nil then
return
elseif type(data_item) == "number" then
if not require "Module:table".isPositiveInteger(data_item) then
discrepancy(modname, "%g, the Wikidata item id for %s (<code>%s</code>), is not a positive integer or a string in the correct format.",
data_item, data[1], code)
end
elseif type(data_item) == "string" then
if not data_item:find "^Q%d+$" then
discrepancy(modname, "%s, the Wikidata item id for %s (<code>%s</code>), is not a string in the correct format or a positive integer.",
data_item, data[1], code)
end
end
end
local function check_other_names_or_aliases(modname, code, canonical_name, data, data_key, allow_nested)
local array = data[data_key]
if not array then
return
end
check_array(modname, code, data, data_key)
local names = {}
local function check_other_name(other_name)
if other_name == canonical_name then
discrepancy(modname,
"%s是<code>%s</code>的名稱,但在<code>%s</code>中重複出現。",
canonical_name, code, data_key)
end
if names[other_name] then
discrepancy(modname,
"The name %s is found twice or more in the list of <code>%s</code> for %s (<code>%s</code>).",
other_name, data_key, canonical_name, code)
end
names[other_name] = true
end
for _, other_name in ipairs(array) do
if type(other_name) == "table" then
if not allow_nested then
discrepancy(modname,
"A nested table is found in the list of <code>%s</code> for %s (<code>%s</code>), but isn't allowed.",
data_key, canonical_name, code)
else
for _, on in ipairs(other_name) do
check_other_name(on)
end
end
else
check_other_name(other_name)
end
end
end
local function check_other_names_aliases_varieties(modname, code, canonical_name, data)
if data.otherNames then
check_other_names_or_aliases(modname, code, canonical_name, data, "otherNames")
end
if data.aliases then
check_other_names_or_aliases(modname, code, canonical_name, data, "aliases")
end
if data.varieties then
check_other_names_or_aliases(modname, code, canonical_name, data, "varieties", true)
end
end
local get_codepoint = mw.ustring.codepoint
local function validate_pattern(pattern, modname, code, data, standardChars)
if type(pattern) ~= "string" then
discrepancy(modname, '"%s", the %spattern for %s (<code>%s</code>), is not a string.',
pattern, standardChars and 'standard character ' or '', code, data[1])
end
local ranges
for lower, higher in mw.ustring.gmatch(pattern, "(.)%-%%?(.)") do
if get_codepoint(lower) >= get_codepoint(higher) then
ranges = ranges or Array()
table.insert(ranges, { lower, higher })
end
end
if ranges and ranges[1] then
local plural = #ranges ~= 1 and "s" or ""
discrepancy(modname, '%s (<code>%s</code>) specifies an invalid pattern ' ..
'for %scharacter detection: <code>"%s"</code>. The first codepoint%s ' ..
'in the range%s %s %s must be less than the second.',
link(data[1]), code, standardChars and 'standard ' or '', pattern, plural, plural,
ranges
:map(
function(range)
return range[1] .. "-" .. range[2] .. (" (U+%X, U+%X)")
:format(get_codepoint(range[1]), get_codepoint(range[2]))
end)
:concat(", "),
#ranges ~= 1 and "are" or "is")
end
if not pcall(mw.ustring.find, "", "[" .. pattern .. "]") then
discrepancy(modname, '%s (<code>%s</code>) specifies an invalid pattern for ' ..
(standardChars and 'standard' or '') .. ' character detection: <code>"%s"</code>',
link(data.canonical_name), code, pattern)
end
end
local remove_exceptions_addition = 0xF0000
local maximum_code_point = 0x10FFFF
local remove_exceptions_maximum_code_point = maximum_code_point - remove_exceptions_addition
local function check_entry_name_or_sortkey(modname, code, data, replacements_name)
local canonical_name = data[1]
local replacements = data[replacements_name]
if type(replacements) == "string" then
if not (replacements_name == "sort_key" or replacements_name == "entry_name") then
discrepancy(modname, "The %s field in the data table for %s (<code>%s</code>) must be a table.",
replacements_name, canonical_name, code)
end
return
end
if (replacements.from ~= nil) ~= (replacements.to ~= nil) then
discrepancy(modname,
"The <code>from</code> and <code>to</code> arrays in the <code>%s</code> table for %s (<code>%s</code>) are not both defined or both undefined.",
replacements_name, canonical_name, code)
elseif replacements.from then
for _, key in ipairs { "from", "to" } do
check_array(modname, code, data, key, replacements_name)
end
end
if replacements.remove_diacritics and type(replacements.remove_diacritics) ~= "string" then
discrepancy(modname,
"The <code>remove_diacritics</code> field in the <code>%s</code> table for %s (<code>%s</code>) table must be a string.",
replacements_name, canonical_name, code)
end
if replacements.remove_exceptions then
if check_array(modname, code, data, "remove_exceptions", replacements_name) then
for sequence_i, sequence in ipairs(replacements.remove_exceptions) do
local code_point_i = 0
for code_point in mw.ustring.gcodepoint(sequence) do
code_point_i = code_point_i + 1
if code_point > remove_exceptions_maximum_code_point then
discrepancy(modname,
"Code point #%d (0x%04X) in field #%d of the <code>remove_exceptions</code> array for %s (<code>%s</code>) is over U+%04X.",
code_point_i, code_point, sequence_i, canonical_name, code, remove_exceptions_maximum_code_point)
end
end
end
end
end
if replacements.from and replacements.to
and m_table.length(replacements.to) > m_table.length(replacements.from) then
discrepancy(modname,
"The <code>from</code> array in the <code>%s</code> table for %s (<code>%s</code>) must be shorter or the same length as the <code>to</code> array.",
replacements_name, canonical_name, code)
end
end
local function has_regular_language_child(parent_code)
for code, data in pairs(m_language_data) do
local ancestors = data.ancestors
if ancestors then
for _, ancestor in pairs(ancestors) do
if ancestor == parent_code then
return true
end
end
end
end
return false
end
local function check_ancestors(modname, code, data, ancestors, is_etymology_language)
if type(ancestors) == "string" then ancestors = mw.text.split(ancestors, "%s*,%s*") end
local canonical_name = data[1]
for _, ancestor_code in ipairs(ancestors) do
if not (m_language_data[ancestor_code] or m_etym_language_data[ancestor_code]) then
discrepancy(modname,
"%s (<code>%s</code>) lists an invalid language code <code>%s</code> as ancestor.",
link(canonical_name), code, ancestor_code)
end
end
end
local function check_code_to_name_and_name_to_code_maps(
source_module_description,
code_to_module_map, name_to_code_map,
code_to_name_modname, code_to_name_module,
name_to_code_modname, name_to_code_module)
local function check_code_and_name(modname, code, canonical_name)
if not code_to_module_map[code] then
if not name_to_code_map[canonical_name] then
discrepancy(modname,
"The code <code>%s</code> and the canonical name %s should be removed; they are not found in %s.",
code, canonical_name, source_module_description)
else
discrepancy(modname,
"<code>%s</code>, the code for the canonical name %s, is wrong; it should be <code>%s</code>.",
code, canonical_name, name_to_code_map[canonical_name])
end
elseif not name_to_code_map[canonical_name] then
local data_table = require("Module:" .. code_to_module_map[code])[code]
discrepancy(modname,
"%s, the canonical name for the code <code>%s</code>, is wrong; it should be %s.",
canonical_name, code, data_table[1])
end
end
for code, canonical_name in pairs(code_to_name_module) do
check_code_and_name(code_to_name_modname, code, canonical_name)
end
for canonical_name, code in pairs(name_to_code_module) do
check_code_and_name(name_to_code_modname, code, canonical_name)
end
end
local function check_extraneous_extra_data(
data_modname, data_module, extra_data_modname, extra_data_module)
for code, _ in pairs(extra_data_module) do
if not data_module[code] then
discrepancy(extra_data_modname,
"Language code <code>%s</code> is not found in [[Module:%s]], and should be removed from [[Module:%s]].",
code, data_modname, extra_data_modname
)
end
end
end
-- Just trying to not have a module error when someone puts a script code
-- in the position of a language code.
local function show_family_code(code)
if type(code) == "string" then
return "<code>" .. code .. "</code>"
else
return require("Module:debug").highlight_dump(code)
end
end
do
local function has_ancestor(lang, code)
for _, anc in ipairs(lang:getAncestors()) do
if code == anc:getCode() or has_ancestor(anc, code) then
return true
end
end
end
local function get_default_ancestors(lang)
if lang:hasType("etymology-only") then
local parent = lang:getParent()
if not has_ancestor(parent, lang:getCode()) then
return parent:getAncestorCodes()
end
end
local fam_code, def_anc = lang:getFamilyCode()
while fam_code and fam_code ~= "qfa-not" do
local fam = m_family_data[fam_code]
def_anc = fam.protoLanguage or
m_language_data[fam_code .. "-pro"] and fam_code .. "-pro" or
m_etym_language_data[fam_code .. "-pro"] and fam_code .. "-pro"
if def_anc and def_anc ~= lang:getCode() then
return {def_anc}
end
fam_code = fam[3]
end
end
local function iterate_ancestor(code, data, modname, anc_code, lang, fam)
local anc = m_languages.getByCode(anc_code, nil, true)
if not anc then
discrepancy(modname,
"%s (<code>%s</code>) lists an invalid language code <code>%s</code> as ancestor.",
link(data), code, anc_code)
return
end
local anc_fam = anc:getFamily()
local anc_fam_code = anc_fam:getCode()
local def_ancs = get_default_ancestors(lang)
if def_ancs then
for _, def_anc in ipairs(def_ancs) do
def_anc = m_languages.getByCode(def_anc, nil, true)
if def_anc and (
anc_code == def_anc:getCode() or
has_ancestor(def_anc, anc_code) or
def_anc:hasParent(anc_code) and not has_ancestor(anc, def_anc:getCode())
) then
discrepancy(modname,
"%s (<code>%s</code>) has the %s (<code>%s</code>) listed in its ancestor field, which is redundant, since it is calculated to be ancestral automatically.",
link(data), code,
link(anc:getRawData()), anc_code)
end
end
end
if not lang:inFamily(anc_fam_code) then
discrepancy(modname,
"%s (<code>%s</code>) has %s (<code>%s</code>) set as an ancestor, but is not in the %s (<code>%s</code>).",
link(data), code,
link(anc:getRawData()), anc_code,
link(anc_fam:getRawData()), anc_fam_code)
end
local fam, proto = lang
repeat
fam = fam:getFamily()
proto = fam and fam:getProtoLanguage()
until proto or not fam or fam:getCode() == "qfa-not"
if proto and not (
proto:getCode() == anc:getCode() or
proto:hasAncestor(anc:getCode()) or
anc:hasAncestor(proto:getCode())
) then
local fam = lang:getFamily()
discrepancy(modname,
"%s (<code>%s</code>) is in the %s (<code>%s</code>) and has %s (<code>%s</code>) set as an ancestor, but it is not possible to form an ancestral chain between them.",
link(data), code,
link(fam:getRawData()), fam:getCode(),
link(anc:getRawData()), anc_code)
end
end
function export.check_ancestors(code, data, modname)
local ancestors = data.ancestors
if not ancestors then
return
elseif type(ancestors) == "string" then
ancestors = split(ancestors, "%s*,%s*")
end
local lang = m_languages.getByCode(code, nil, true)
local fam = lang:getFamily()
for _, anc in ipairs(ancestors) do
iterate_ancestor(code, data, modname, anc, lang, fam)
end
end
end
local function check_languages()
local check_language_data_keys = check_data_keys{
1, 2, 3, 4, -- canonical name, wikidata item, family, scripts
"display_text", "generate_forms", "entry_name", "sort_key",
"otherNames", "aliases", "varieties",
"type", "ancestors",
"wikimedia_codes", "wikipedia_article", "standardChars",
"translit", "override_translit", "link_tr",
"dotted_dotless_i"
}
local function check_language(modname, code, data, mainData, extraData)
local canonical_name, lang_type = data[1], data.type
check_language_data_keys(modname, code, data)
if all_codes[code] then
discrepancy(modname, "Code <code>%s</code> is not unique; it is also defined in [[Module:%s]].", code, all_codes[code])
else
if not m_language_codes[code] then
discrepancy("languages/code to canonical name", "代碼<code>%s</code>(%s)缺失。", code, canonical_name)
end
all_codes[code] = modname
end
if not canonical_name then
discrepancy(modname, "Code <code>%s</code> has no canonical name specified.", code)
elseif language_names[canonical_name] then
discrepancy(modname,
"%s (<code>%s</code>) 的規範名稱不唯一,同時被代碼<code>%s</code>使用。",
link(canonical_name), code, language_names[canonical_name])
else
if not m_language_canonical_names[canonical_name] then
discrepancy("languages/canonical names", "規範名稱「%s」(<code>%s</code>)缺失。", canonical_name, code)
end
language_names[canonical_name] = code
end
check_wikidata_item(modname, code, data, 2)
if extraData then
check_other_names_aliases_varieties(modname, code, canonical_name, extraData)
end
if lang_type and not (lang_type == "regular" or lang_type == "reconstructed" or lang_type == "appendix-constructed") then
discrepancy(modname, "%s (<code>%s</code>) is of an invalid type <code>%s</code>.", link(canonical_name), code, data.type)
end
if mainData.aliases then
discrepancy(modname, "%s (<code>%s</code>) has the <code>aliases</code> key. This must be moved to [[Module:" .. modname .. "/extra]].", link(canonical_name), code)
end
if mainData.varieties then
discrepancy(modname, "%s (<code>%s</code>) has the <code>varieties</code> key. This must be moved to [[Module:" .. modname .. "/extra]].", link(canonical_name), code)
end
if mainData.otherNames then
discrepancy(modname, "%s (<code>%s</code>) has the <code>otherNames</code> key. This must be moved to [[Module:" .. modname .. "/extra]].", link(canonical_name), code)
end
if not extraData then
discrepancy(modname .. "/extra", "%s (<code>%s</code>) has data in [[Module:" .. modname .. "]], but does not have corresponding data in [[Module:" .. modname .. "/extra]].", link(canonical_name), code)
--elseif extraData.otherNames then
-- discrepancy(modname .. "/extra", "%s (<code>%s</code>) has <code>otherNames</code> key, but these should be changed to either <code>aliases</code> or <code>varieties</code>.", link(canonical_name), code)
end
local sc = data[4]
if sc then
if type(sc) == "string" then
sc = mw.text.split(sc, "%s*,%s*")
end
if type(sc) == "table" then
if not sc[1] then
discrepancy(modname, "%s (<code>%s</code>) has no scripts listed.", link(canonical_name), code)
else
for _, sccode in ipairs(sc) do
local cur_sc = m_script_data[sccode]
if not cur_sc and sccode ~= "All" then
discrepancy(modname,
"%s (<code>%s</code>) lists an invalid script code <code>%s</code>.",
link(canonical_name), code, sccode)
-- elseif not cur_sc.characters then
-- discrepancy(modname,
-- "%s (<code>%s</code>) lists a script without characters <code>%s</code> (%s).",
-- link(canonical_name), code, sccode, cur_sc[1])
end
nonempty_scripts[sccode] = true
end
end
else
discrepancy(modname,
"The %s field for %s (<code>%s</code>) must be a table or string.",
4, link(canonical_name), code)
end
end
if data.ancestors then
export.check_ancestors(code, data, modname)
end
if data[3] then
local family = data[3]
if not m_family_data[family] then
discrepancy(modname,
"%s (<code>%s</code>) has an invalid family code %s.",
link(canonical_name), code, show_family_code(family))
end
nonempty_families[family] = true
end
if data.sort_key then
check_entry_name_or_sortkey(modname, code, data, "sort_key")
end
if data.entry_name then
check_entry_name_or_sortkey(modname, code, data, "entry_name")
end
if data.display then
check_entry_name_or_sortkey(modname, code, data, "display")
end
if data.standardChars then
if type(data.standardChars) == "table" then
local sccodes = {}
for _, sccode in ipairs(sc) do
sccodes[sccode] = true
end
for sccode in pairs(data.standardChars) do
if not (sccodes[sccode] or sccode == 1) then
discrepancy(modname, "The field %s in the standardChars table for %s (<code>%s</code>) does not match any script for that language.",
sccode, canonical_name, code)
end
end
elseif data.standardChars and type(data.standardChars) ~= "string" then
discrepancy(modname, "The standardChars field in the data table for %s (<code>%s</code>) must be a string or table.",
canonical_name, code)
end
end
check_true_or_nil(modname, code, data, "override_translit")
check_true_or_nil(modname, code, data, "link_tr")
if data.override_translit and not data.translit then
discrepancy(modname,
"%s (<code>%s</code>) has <code>override_translit</code> set, but no transliteration module",
link(canonical_name), code)
end
end
-- Check two-letter codes
local modname = "languages/data/2"
local data2 = mw.loadData("Module:" .. modname)
local extra_modname = modname .. "/extra"
local extradata2 = mw.loadData("Module:" .. extra_modname)
for code, data in pairs(data2) do
if not code:find("^[a-z][a-z]$") then
discrepancy(modname, '%s (<code>%s</code>) 沒有雙字母代碼。', link(data[1]), code)
end
check_language(modname, code, data, data2[code], extradata2[code])
end
-- Check three-letter codes
for i = string.byte('a'), string.byte('z') do
local letter = string.char(i)
local modname = "languages/data/3/" .. letter
local data3 = mw.loadData("Module:" .. modname)
local extra_modname = modname .. "/extra"
local extradata3 = mw.loadData("Module:" .. extra_modname)
local code_pattern = "^" .. letter .. "[a-z][a-z]$"
for code, data in pairs(data3) do
if not code:find(code_pattern) then
discrepancy(modname,
'%s (<code>%s</code>) 沒有以"<code>%s</code>"開頭的三字母代碼。',
link(data[1]), code, letter)
end
check_language(modname, code, data, data3[code], extradata3[code])
end
check_extraneous_extra_data(modname, data3, extra_modname, extradata3)
end
-- Check exceptional codes
modname = "languages/data/exceptional"
local datax = mw.loadData("Module:" .. modname)
extra_modname = modname .. "/extra"
local extradatax = mw.loadData("Module:" .. extra_modname)
for code, data in pairs(datax) do
if code:find("^[a-z][a-z][a-z]?$") then
discrepancy(modname, '%s (<code>%s</code>) 有雙字母或三字母的代碼。', link(data[1]), code)
end
check_language(modname, code, data, datax[code], extradatax[code])
end
check_extraneous_extra_data(modname, datax, extra_modname, extradatax)
-- These checks must be done while all_codes only contains language codes:
-- that is, after language data modules have been processed, but before
-- etymology languages, families, and scripts have.
check_code_to_name_and_name_to_code_maps(
"a submodule of [[Module:languages]]",
all_codes, language_names,
"languages/code to canonical name", m_language_codes,
"languages/canonical names", m_language_canonical_names)
-- Check [[Template:langname-lite]]
local frame = mw.getCurrentFrame()
local content = mw.title.new("Template:langname-lite"):getContent()
content = content:gsub("%<%!%-%-.-%-%-%>", "") -- remove comments
local match = mw.ustring.gmatch(content, "\n\t*|#*([^\n]+)=([^\n]*)")
while true do
local code, name, check_name = match()
if not code then return "OK" end
if code:len() > 1 and code ~= "default" then
for _, code in pairs(mw.text.split(code, "|")) do
local lang = m_languages.getByCode(code, nil, true, true)
if name:match("etymcode") then
local nonEtym_name = frame:preprocess(name)
local nonEtym_real_name = lang:getFullName()
if nonEtym_name ~= nonEtym_real_name then
discrepancy("Template:langname-lite", "代碼:<code>" .. code .. "</code>。現有名稱:" .. nonEtym_name .. "。預期名稱:" .. nonEtym_real_name .. "。")
end
name = frame:preprocess(name:gsub("{{{allow etym|}}}", "1"))
elseif name:match("familycode") then
name = name:match("familycode|(.-)|")
else
name = name
end
if not lang then
discrepancy("Template:langname-lite", "代碼:<code>" .. code .. "</code>。現有名稱:" .. name .. "。語言不在資料中。")
else
local real_name = lang:getCanonicalName()
if name ~= real_name then
discrepancy("Template:langname-lite", "代碼:<code>" .. code .. "</code>。現有名稱:" .. name .. "。預期名稱:" .. real_name .. "。")
end
end
end
end
end
end
local function check_etym_languages()
local modname = "etymology languages/data"
local check_etymology_language_data_keys = check_data_keys{
1, 2, 3, 4, 5, -- canonical name, wikidata item, family, scripts, parent
"display_text", "generate_forms", "entry_name", "sort_key",
"otherNames", "aliases", "varieties",
"type", "main_code", "ancestors",
"wikimedia_codes", "wikipedia_article", "standardChars",
"translit", "override_translit", "link_tr",
"dotted_dotless_i"
}
local function link(name)
if not name then
return "???"
elseif name:find("[Ll]anguage$") then
return name
else
return name
end
end
for code, data in pairs(m_etym_language_data) do
local canonical_name, parent =
data[1], data[5]
check_etymology_language_data_keys(modname, code, data)
if all_codes[code] then
discrepancy(modname, "Code <code>%s</code> is not unique; it is also defined in [[Module:%s]].", code, all_codes[code])
else
if not m_etym_language_codes[code] then
discrepancy("etymology languages/code to canonical name", "代碼<code>%s</code>(%s)缺失。", code, canonical_name)
end
all_codes[code] = modname
end
if not canonical_name then
discrepancy(modname, "Code <code>%s</code> has no canonical name specified.", code)
elseif language_names[canonical_name] then
local m_canonical_lang = m_languages.getByCanonicalName(canonical_name, nil, true)
if not m_canonical_lang then
discrepancy(modname, "%s (<code>%s</code>) has a canonical name that cannot be looked up.",
link(canonical_name), code)
elseif data.main_code ~= m_canonical_lang:getCode() then
discrepancy(modname,
"%s (<code>%s</code>) has a canonical name that is not unique; it is also used by the code <code>%s</code>.",
link(canonical_name), code, language_names[canonical_name])
end
else
if not m_etym_language_canonical_names[canonical_name] then
discrepancy("etymology languages/canonical names", "規範名稱「%s」(<code>%s</code>)缺失。", canonical_name, code)
end
language_names[canonical_name] = code
end
check_other_names_aliases_varieties(modname, code, canonical_name, data)
if parent then
if type(parent) ~= "string" then
discrepancy(modname,
"Etymology-only %s (<code>%s</code>) has a parent language or family code that is %s rather than a string.",
link(canonical_name), code, parent == nil and "nil" or "a " .. type(parent))
elseif not (m_language_data[parent] or m_family_data[parent] or m_etym_language_data[parent]) then
discrepancy(modname,
"Etymology-only %s (<code>%s</code>) has invalid parent language or family code <code>%s</code>.",
link(canonical_name), code, parent)
end
nonempty_families[parent] = true
else
discrepancy(modname,
"Etymology-only %s (<code>%s</code>) has no parent language or family code.",
link(canonical_name), code)
end
if data.ancestors then
export.check_ancestors(code, data, modname)
end
if data[3] then
local family = data[3]
if not m_family_data[family] then
discrepancy(modname,
"%s (<code>%s</code>) has an invalid family code %s.",
link(canonical_name), code, show_family_code(family))
end
nonempty_families[family] = true
end
check_wikidata_item(modname, code, data, 2)
end
local checked = {}
for code, data in pairs(m_etym_language_data) do
local stack = {}
while data do
if checked[data] then
break
end
if stack[data] then
discrepancy(modname, "%s (<code>%s</code>) has a cyclic parental relationship to %s (<code>%s</code>)",
link(data[1]), code,
link(m_etym_language_data[data[5]][1]), data.parent or data[5]
)
break
end
stack[data] = true
code, data = data[5], data[5] and m_etym_language_data[data[5]]
end
for data in pairs(stack) do
checked[data] = true
end
end
check_code_to_name_and_name_to_code_maps(
"[[Module:etymology languages/data]]",
all_codes, language_names,
"etymology languages/code to canonical name", m_etym_language_codes,
"etymology languages/canonical names", m_etym_language_canonical_names)
end
local function check_families()
local modname = "families/data"
local check_family_data_keys = check_data_keys{
1, 2, 3, -- canonical name, wikidata item, (parent) family
"type",
"protoLanguage", "otherNames", "aliases", "varieties",
}
local function link(name)
if not name then
return "???"
elseif name:find("[Ll]anguages$") then
return "[[:Category:" .. name .. "|" .. name .. "]]"
else
return "[[:Category:" .. name .. "|" .. name .. "]]"
end
end
for code, data in pairs(m_family_data) do
check_family_data_keys(modname, code, data)
local canonical_name, family = data[1], data[3]
if all_codes[code] then
discrepancy(modname, "代碼<code>%s</code>不唯一,同時定義於[[Module:%s]]。", code, all_codes[code])
else
if not m_family_codes[code] then
discrepancy("families/code to canonical name", "代碼<code>%s</code>(%s)缺失。", code, canonical_name)
end
all_codes[code] = modname
end
if not canonical_name then
discrepancy(modname, "代碼<code>%s</code>沒有指定規範名稱。", code)
elseif family_names[canonical_name] then
discrepancy(modname,
"%s (<code>%s</code>) 的規範名稱不唯一,同時被代碼<code>%s</code>使用",
link(canonical_name), code, family_names[canonical_name])
else
if not m_family_canonical_names[canonical_name] then
discrepancy("families/canonical names", "規範名稱「%s」(<code>%s</code>)缺失。", canonical_name, code)
end
family_names[canonical_name] = code
end
if data[2] and type(data[2]) ~= "number" then
discrepancy(modname, "%s (<code>%s</code>) has a wikidata item value that is not a number or <code>nil</code>: %s", link(canonical_name), code, mw.dumpObject(data[2]))
end
check_other_names_aliases_varieties(modname, code, canonical_name, data)
if family then
if family == code and code ~= "qfa-not" then
discrepancy(modname,
"%s (<code>%s</code>) has itself as its family.",
link(canonical_name), code)
elseif not m_family_data[family] then
discrepancy(modname,
"%s (<code>%s</code>) has an invalid parent family code %s.",
link(canonical_name), code, show_family_code(family))
end
nonempty_families[family] = true
end
check_wikidata_item(modname, code, data, 2)
end
for code, data in pairs(m_family_data) do
if not (nonempty_families[code] or allowed_empty_families[code]) then
discrepancy(modname, "%s (<code>%s</code>) has no child families or languages.", link(data[1]), code)
end
end
local checked = { ['qfa-not'] = true }
for code, data in pairs(m_family_data) do
local stack = {}
while data do
if checked[code] then
break
end
if stack[code] then
discrepancy(modname, "%s (<code>%s</code>) has a cyclic parental relationship to %s (<code>%s</code>)",
link(data[1]), code,
link(m_family_data[data[3]][1]), data[3]
)
break
end
stack[code] = true
code, data = data[3], m_family_data[data[3]]
end
for code in pairs(stack) do
checked[code] = true
end
end
check_code_to_name_and_name_to_code_maps(
"[[Module:families/data]]",
all_codes, family_names,
"families/code to canonical name", m_family_codes,
"families/canonical names", m_family_canonical_names)
end
local function check_scripts()
local modname = "scripts/data"
local check_script_data_keys = check_data_keys({
1, 2, -- canonical name, writing systems
"canonicalName", "otherNames", "aliases", "varieties", "parent",
"wikipedia_article", "ranges", "characters", "spaces", "capitalized", "translit", "direction",
"character_category", "normalizationFixes"
}, true)
local m_script_codes = require('Module:scripts/code to canonical name')
local m_script_canonical_names = require('Module:scripts/by name')
-- Just to satisfy requirements of check_code_to_name_and_name_to_code_maps.
local script_code_to_module_map = {}
for code, data in pairs(m_script_data) do
local canonical_name = data[1]
if not m_script_codes[code] and #code == 4 then
discrepancy('scripts/code to canonical name', '<code>%s</code> (%s) 缺失', code, canonical_name)
end
check_script_data_keys(modname, code, data)
if not canonical_name then
discrepancy(modname, "Code <code>%s</code> has no canonical name specified.", code)
elseif script_names[canonical_name] then
--[=[
discrepancy(modname,
"%s (<code>%s</code>) has a canonical name that is not unique; it is also used by the code <code>%s</code>.",
link_script(data.names[1]), code, script_names[data.names[1]])
--]=]
else
if not m_script_canonical_names[canonical_name] and #code == 4 then
discrepancy('scripts/by name', '「%s」(<code>%s</code>)缺失。', canonical_name, code)
end
script_names[canonical_name] = code
end
check_other_names_aliases_varieties(modname, code, canonical_name, data)
if not nonempty_scripts[code] then
discrepancy(modname,
"%s(<code>%s</code>)未被任何語言使用%s。",
link_script(canonical_name), code, data.characters and ""
or "並且沒有給出供自動檢測所用的字元")
--[[
elseif not data.characters then
discrepancy(modname, "%s (<code>%s</code>) has no characters listed for auto-detection.", link_script(canonical_name), code)
--]]
end
if data.characters then
validate_pattern(data.characters, modname, code, data, false)
end
script_code_to_module_map[code] = modname
end
check_code_to_name_and_name_to_code_maps(
"a submodule of [[Module:scripts]]",
script_code_to_module_map, script_names,
"scripts/code to canonical name", m_script_codes,
"scripts/by name", m_script_canonical_names)
end
local function check_labels()
local check_label_data_keys = check_data_keys{
"display", "Wikipedia", "glossary",
"plain_categories", "topical_categories", "pos_categories", "regional_categories", "sense_categories",
"omit_preComma", "omit_postComma", "omit_preSpace",
"deprecated", "track"
}
local function check_label(modname, code, data)
local typ = type(data)
if typ == "table" then
check_label_data_keys(modname, code, data)
elseif typ ~= "string" then
discrepancy(modname,
"The data for label <code>%s</code> is a %s; only tables and strings are allowed.",
code, typ)
end
end
for _, module in ipairs{"", "/regional", "/topical"} do
local modname = "Module:labels/data" .. module
module = require(modname)
for label, data in pairs(module) do
check_label(modname, label, data)
end
end
for code in pairs(m_language_codes) do
local modname = "Module:labels/data/lang/" .. code
local ok, module = pcall(require, modname)
if ok then
for label, data in pairs(module) do
check_label(modname, label, data)
end
end
end
end
local function check_zh_trad_simp()
local m_ts = mw.loadData("Module:zh/data/ts")
local m_st = mw.loadData("Module:zh/data/st")
local ruby = require("Module:ja-ruby").ruby_auto
local lang = m_languages.getByCode("zh")
local Hant = m_scripts.getByCode("Hant")
local Hans = m_scripts.getByCode("Hans")
local data = {[0] = m_st, m_ts}
local mod = {[0] = "st", "ts"}
local var = {[0] = "Simp.", "Trad."}
local sc = {[0] = Hans, Hant}
local function find_stable_loop(chars, other, j)
local display = ruby({["markup"] = "[" .. other .. "](" .. var[(j+1)%2] .. ")"})
display = m_links.language_link{term = other, alt = display, lang = lang, sc = sc[(j+1)%2], tr = "-"}
table.insert(chars, display)
if data[(j+1)%2][other] == other then
table.insert(chars, other)
return chars, 1
elseif not data[(j+1)%2][other] then
table.insert(chars, "not found")
return chars, 2
elseif data[j%2][data[(j+1)%2][other]] ~= other then
return find_stable_loop(chars, data[(j+1)%2][other], j + 1)
else
local display = ruby({["markup"] = "[" .. data[(j+1)%2][other] .. "](" .. var[j%2] .. ")"})
display = m_links.language_link{term = data[(j+1)%2][other], alt = display, lang = lang, sc = sc[j%2], tr = "-"}
table.insert(chars, display .. " (")
display = ruby({["markup"] = "[" .. data[j%2][data[(j+1)%2][other]] .. "](" .. var[(j+1)%2] .. ")"})
display = m_links.language_link{term = data[j%2][data[(j+1)%2][other]], alt = display, lang = lang, sc = sc[(j+1)%2], tr = "-"}
table.insert(chars, display .. " etc.)")
return chars, 3
end
return chars, issue
end
for i = 0, 1, 1 do
for char, other in pairs(data[i]) do
if data[(i+1)%2][other] ~= char then
local chars, issue = {}
local display = ruby({["markup"] = "[" .. char .. "](" .. var[i] .. ")"})
display = m_links.language_link{term = char, alt = display, lang = lang, sc = sc[i], tr = "-"}
table.insert(chars, display)
chars, issue = find_stable_loop(chars, other, i)
if issue == 1 or issue == 2 then
local sc_this, mod_this, j = {}
if chars[#chars-1]:match(var[(i+1)%2]) then
j = 1
else
j = 0
end
mod_this = mod[(i+j)%2]
sc_this = {[0] = sc[(i+j)%2], sc[(i+j+1)%2]}
for k, char in ipairs(chars) do
chars[k] = m_script_utils.tag_text(char, lang, sc_this[k%2], "term")
end
if issue == 1 then
discrepancy("zh/data/" .. mod_this, "字元引用自身:" .. table.concat(chars, " → "))
elseif issue == 2 then
discrepancy("zh/data/" .. mod_this, "缺失字元:" .. table.concat(chars, " → "))
end
elseif issue == 3 then
for j, char in ipairs(chars) do
chars[j] = m_script_utils.tag_text(char, lang, sc[(i+j)%2], "term")
end
discrepancy("zh/data/" .. mod[i], "可能不匹配的字元:" .. table.concat(chars, " → "))
end
end
end
end
end
local function check_serialization(modname)
local serializers = {
["Hani-sortkey/data/serialized"] = "Hani-sortkey/serializer",
}
if not serializers[modname] then
return nil
end
local serializer = serializers[modname]
local current_data = require("Module:" .. serializer).main(true)
local stored_data = require("Module:" .. modname)
if current_data ~= stored_data then
discrepancy(modname, "<strong><u>Important!</u> Serialized data is out of sync. Use [[Module: ".. serializer .. "]] to update it. If you have made any changes to the underlying data, the serialized data <u>must</u> be updated before these changes will take effect.</strong>")
end
end
-- Warning: cannot be called twice in the same module invocation because
-- some module-global variables are not reset between calls.
function export.do_checks(modules)
messages = setmetatable({}, {
__index = function (self, k)
local val = Array()
self[k] = val
return val
end
})
if modules["zh/data/ts"] or modules["zh/data/st"] then
check_zh_trad_simp()
end
check_languages()
check_etym_languages()
-- families and scripts must be checked AFTER languages; languages checks fill out
-- the nonempty_families and nonempty_scripts tables, used for testing if a family/script
-- is ever used in the data
check_families()
check_scripts()
if modules["labels/data"] then
check_labels()
end
for module in pairs(modules) do
check_serialization(module)
end
setmetatable(messages, nil)
local function find_code(message)
return string.match(message, "<code>([^<]+)</code>")
end
find_code = require("Module:fun").memoize(find_code)
local function comp(message1, message2)
local code1, code2 = find_code(message1), find_code(message2)
if code1 and code2 then
return code1 < code2
else
return message1 < message2
end
end
for modname, msglist in pairs(messages) do
msglist:sort(comp)
end
local ret = messages
messages = nil
return ret
end
function export.format_message(modname, msglist)
local header; if modname:match("^Module:") or modname:match("^Template:") then
header = "===[[" .. modname .. "]]==="
else
header = "===[[Module:" .. modname .. "]]==="
end
return header
.. msglist
:map(
function(msg)
return "\n* " .. msg
end)
:concat()
end
function export.check_modules(args)
local modules = {}
for i, arg in ipairs(args) do
modules[arg] = true
end
local ret = Array()
local messages = export.do_checks(modules)
for _, module in ipairs(args) do
local msglist = messages[module]
if msglist then
ret:insert(export.format_message(module, msglist))
end
end
return ret:concat("\n")
end
function export.check_modules_t(frame)
local args = m_table.shallowcopy(frame.args)
return export.check_modules(args)
end
function export.perform(frame)
local messages = export.do_checks({})
-- Format the messages
local ret = Array()
for modname, msglist in m_table.sortedPairs(messages) do
ret:insert(export.format_message(modname, msglist))
end
-- Are there any messages?
if i == 1 then
return '<b class="success">Glory to Arstotzka.</b>'
else
ret:insert(1, '<b class="warning">檢測到差異:</b>')
return ret:concat('\n')
end
end
return export