Skip to main content

Reformatting string into tokens with quotes

My mission for this code is to generate a long strings with lots of words into tokens, and reformat each token as string array. The output is like this;

image

And this is the code segment.

<?php
//Tokenize to string array

$sampletext="abang
abu
ada
adat
adik
air
ajak
akal
akar
alah
alas
alim
aliran
alur
ambil
anak
angin
angkat
anjing
api
arang
asal
asam
atas
ayam
bahasa
baik
bangkai
banyak
bapa
basah
batu
bawa
bawah
bayang
bayar
bekas
belah
belahan
belakang
bendera
bengkak
beradu
berair
beralih
berani
berat
berbalik
berbantal
berbelah
berfikiran
bergendang
berhabis
beri
berita
berkandikan
berkerat
berlapang
berpatah
bersihkan
bertilam
bertongkat
berubah
besar
betul
biang
bidan
bintang
bongkar
bongkok
buah
bual
buang
buat
buaya
bujur
buka
buku
bulan
bulat
bunga
buruk
burung
busuk
busung
buta
cabut
cacing
cahaya
cakap
cakar
campur
cari
cecah
cepat
cerai
cerdik"
;

$wcount=0;
$wlist=array();
$tok = strtok($sampletext, " \n\t/?,.()@!|{}[]*\'\"<>");//regular expression of the delimiter
while ($tok != false) {//false means end of line
$wlist[$wcount]=$tok;
$tok = strtok(" \n\t/?,.()@!|{}[]*\'\"<>");
$wcount++;
}

//array with quotes
$string_array_list="candidate_list=array(\"";
for($i=0; $i<$wcount; $i++){//loop to perform double quote
$string_array_list=$string_array_list.trim($wlist[$i])."\",\"";
}

//end string_array_list
$string_array_list=$string_array_list.");";
echo $string_array_list;

?>

Comments

Popular posts from this blog

Several English proverbs and the Malay pair

Or you could download here for the Malay proverbs app – https://play.google.com/store/apps/details?id=net.kerul.peribahasa English proverbs and the Malay pair Corpus Reference: Amir Muslim, 2009. Peribahasa dan ungkapan Inggeris-Melayu. DBP, Kuala Lumpur http://books.google.com.my/books/about/Peribahasa_dan_ungkapan_Inggeris_Melayu.html?id=bgwwQwAACAAJ CTRL+F to search Proverbs in English Definition in English Similar Malay Proverbs Definition in Malay 1 Where there is a country, there are people. A country must have people. Ada air adalah ikan. Ada negeri adalah rakyatnya. 2 Dry bread at home is better than roast meat home's the best hujan emas di negeri orang,hujan batu di negeri sendiri Betapa baik pun tempat orang, baik lagi tempat sendiri. 3 There's no accounting for tastes We can't assume that every people have a same feel Kepala sama hitam hati lain-lain. Dalam kehidupan ini, setiap insan berbeza cara, kesukaan, perangai, tabia...

Submit your blog address here

Create your own blog and send the address by submitting the comment of this article. Make sure to provide your full name, matrix and URL address of your blog. Refer to the picture below. Manual on developing a blog using blogger.com and AdSense, download here … Download Windows Live Writer (a superb offline blog post editor)

Contact Us at blog.kerul.net

Powered by EMF HTML Contact Form

The Challenges of Handling Proverbs in Malay-English Machine Translation – a research paper

*This paper was presented in the 14th International Conference on Translation 2013 ( http://ppa14atf.usm.my/ ). 27 – 29 August 2013, Universiti Sains Malaysia, Penang. The PDF version is here: www.scribd.com/doc/163669571/Khirulnizam-The-Challenges-of-Automated-Detection-and-Translation-of-Malay-Proverb The test data is here: http://www.scribd.com/doc/163669588/Test-Data-for-the-Research-Paper-the-Challenges-of-Handling-Proverbs-in-Malay-English-Machine-Translation Khirulnizam Abd Rahman, Faculty of Information Science & Technology, KUIS Abstract: Proverb is a unique feature of Malay language in which a message or advice is not communicated indirectly through metaphoric phrases. However, the use of proverb will cause confusion or misinterpretation if one does not familiar with the phrases since they cannot be translated literally. This paper will discuss the process of automated filtering of Malay proverb in Malay text. The next process is translation. In machine translatio...

Lab quiz for Web Programming

Scenario You are given a task to develop a simple web database application for a computer shop. The system will store the information of all the branded laptops in the shop. Below are the information needed for the database. Database server information : server address= localhost , username= root , no password Database name: COMPUTERSHOP Table name : Laptops Fields in table Movies : CompID , CompModel , Manufacturer , Processor , RAMCapacity , HarddiskCapacity , Price . Tasks 1. Create the database and table as stated above (using MySQL through phpMyAdmin). 2. Develop the web page by using the combination of HTML and PHP scripts to search and display the laptop information by CompModel . (Create two different pages) 3. Develop a HTML form for the user to insert a record of a new laptop computer. Save the new record in the table Laptops . Send the code to me by 12pm, 25Feb 2009 , by email to khirulnizam@gmail.com …