More Romanian word embeddings from the RETEROM project. Automatically learned vector representations of words, also known as "word embeddings", are becoming a basic building block for more and more natural language processing algorithms. There are different ways and tools for constructing word embeddings. Most of the approaches rely on raw texts, the construction items being the word occurrences and or letter n grams. More elaborated research is using additional linguistic features extracted after text preprocessing. Morphology is clearly served by vector representations constructed from raw texts and letter n grams. Syntax and semantics studies may profit more from the vector representations constructed with additional features such as lemma, part of speech, syntactic or semantic dependants associated with each word. One of the key objectives of the ReTeRom project is the development of advanced technologies for Romanian natural language processing, including morphological, syntactic and semantic analysis of text. As such, we plan to develop an open access large library of ready to use word embeddings sets, each set being characterized by different parameters used features (wordforms, letter n grams, lemmas, POSes etc.), vector lengths, window context size and frequency thresholds. To this end, the previously created sets of word embeddings (based on word occurrences) on the CoRoLa corpus (P u a i c s and Tufi c s , 2018) are and will be further augmented with new representations learned from the same corpus by using specific features such as lemmas and parts of speech. Furthermore, in order to better understand and explore the vectors, graphical representations will be available by customized interfaces.


AudioVisual Video Summarization. Audio and vision are two main modalities in video data. Multimodal learning, especially for audiovisual learning, has drawn considerable attention recently, which can boost the performance of various computer vision tasks. However, in video summarization, existing approaches just exploit the visual information while neglect the audio information. In this paper, we argue that the audio modality can assist vision modality to better understand the video content and structure, and further benefit the summarization process. Motivated by this, we propose to jointly exploit the audio and visual information for the video summarization task, and develop an AudioVisual Recurrent Network (AVRN) to achieve this. Specifically, the proposed AVRN can be separated into three parts 1) the two stream LSTM is utilized to encode the audio and visual feature sequentially by capturing their temporal dependency. 2) the audiovisual fusion LSTM is employed to fuse the two modalities by exploring the latent consistency between them. 3) the self attention video encoder is adopted to capture the global dependency in the video. Finally, the fused audiovisual information, and the integrated temporal and global dependencies are jointly used to predict the video summary. Practically, the experimental results on the two benchmarks, emph i.e., SumMe and TVsum, have demonstrated the effectiveness of each part, and the superiority of AVRN compared to those approaches just exploiting visual information for video summarization.


Convergence of the Yamabe flow on singular spaces with positive Yamabe constant. In this work, we study the convergence of the normalized Yamabe flow with positive Yamabe constant on a class of pseudo manifolds that includes stratified spaces with iterated cone edge metrics. We establish convergence under a low energy condition. We also prove a concentration compactness dichotomy, and investigate what the alternatives to convergence are. We end by investigating a non convergent example due to Viaclovsky in more detail.


H ModQuad Modular Multi Rotors with 4, 5, and 6 Controllable DOF. Traditional aerial vehicles are usually custom designed for specific tasks. Although they offer an efficient solution, they are not always able to adapt to changes in the task specification, e.g., increasing the payload. This applies to quadrotors, having a maximum payload and only four controllable degrees of freedom, limiting their adaptability to the task's variations. We propose a versatile modular robotic system that can increase its payload and degrees of freedom by assembling heterogeneous modules we call it H ModQuad. It consists of cuboid modules propelled by quadrotors with tilted propellers that can generate forces in different directions. By connecting different types of modules, an H ModQuad can increase its controllable degrees of freedom from 4 to 5 and 6. We model the general structure and propose three controllers, one for each number of controllable degrees of freedom. We extend the concept of the actuation ellipsoid to find the best reference orientation that can maximize the performance of the structure. Our approach is validated with experiments using actual robots, showing the independence of the translation and orientation of a structure.


LS CAT A Large Scale CUDA AutoTuning Dataset. The effectiveness of Machine Learning (ML) methods depend on access to large suitable datasets. In this article, we present how we build the LS CAT (Large Scale CUDA AutoTuning) dataset sourced from GitHub for the purpose of training NLP based ML models. Our dataset includes 19 683 CUDA kernels focused on linear algebra. In addition to the CUDA codes, our LS CAT dataset contains 5 028 536 associated runtimes, with different combinations of kernels, block sizes and matrix sizes. The runtime are GPU benchmarks on both Nvidia GTX 980 and Nvidia T4 systems. This information creates a foundation upon which NLP based models can find correlations between source code features and optimal choice of thread block sizes. There are several results that can be drawn out of our LS CAT database. E.g., our experimental results show that an optimal choice in thread block size can gain an average of 6 for the average case. We thus also analyze how much performance increase can be achieved in general, finding that in 10 of the cases more than 20 performance increase can be achieved by using the optimal block. A description of current and future work is also included.


Analogues of Finite Blaschke Products as Inner Functions. We give a generalization of the notion of finite Blaschke products from the perspective of generalized inner functions in various reproducing kernel Hilbert spaces. Further, we study precisely how these functions relate to so called Shapiro Shields functions and shift invariant subspaces generated by polynomials.


Latency of Concatenating Unlicensed LPWAN with Cellular IoT An Experimental QoE Study. Developing low power wide area network (LPWAN) solutions that are efficient to adopt, deploy and maintain are vital for smart cities. The poor quality of service of unlicensed LPWAN, and the high service cost of LTE M NB IoT are key disadvantages of these technologies. Concatenating unlicensed with licensed LPWANs can overcome these limitations and harness their benefits. However, a concatenated LPWAN architecture will inevitably result in excess latency which may impact users' quality of experience (QoE). To evaluate the real life feasibility of this system, we first propose a concatenated LPWAN architecture and experimentally measure the statistics of end to end (E2E) latencies. The concatenated delay margin is determined by benchmarking the latencies with different LPWAN architecture schemes, namely with unlicensed IoT (standalone LoRa), cellular IoT (standalone LTE M), and concatenated IoT (LoRa interfaced with LTE M). Through extensive experimental measurement campaigns of 30,000 data points of E2E latencies, we show that the excess delay due to LPWAN interfacing introduces on average less than 300 milliseconds. The proof of concept results suggest that the latency for concatenating unlicensed LPWAN with cellular IoT is negligible for smart city use cases where human perception and decision making is in the loop.


On the Mertens Conjecture over Number Fields. We introduce a number field analogue of the Mertens conjecture and demonstrate its falsity for all but finitely many number fields of any given degree. We establish the existence of a logarithmic limiting distribution for the analogous Mertens function, expanding upon work of Ng. Finally, we explore properties of the generalized Mertens function of certain dicyclic number fields as consequences of Artin factorization.


SWIPT Enabled Multiple Access Channel Effects of Decoding Cost and Non linear EH Model. We studied power splitting based simultaneous wireless information and power transfer (PS SWIPT) in multiple access channels (MAC), considering the decoding cost and non linear energy harvesting (EH) constraints at the receiving nodes to study practical limitations of an EH communication system. Under these restrictions, we formulated and analyzed the achievable rate and maximum departure regions in two well studied scenarios, i.e., a classical PS SWIPT MAC and a PS SWIPT MAC with user cooperation. In the classical PS SWIPT MAC setting, closed form expressions for the optimal values of the PS factors are derived for two fundamental decoding schemes simultaneous decoding and successive interference cancellation. In the PS SWIPT MAC with user cooperation, the joint optimal power allocation for users as well as the optimal PS factor are derived. This reveals that one decoding scheme outperforms the other in the classical PS SWIPT MAC, depending on the function type of the decoding cost. Finally, it is shown that the cooperation between users can potentially boost the performance of a PS SWIPT MAC under decoding cost and non linear EH constraints. Moreover, effects of the decoding cost functions, non linear EH model and channel quality between the users are studied, and performance characteristics of the system are discussed.


A Ramsey Theorem for Finite Monoids. Repeated idempotent elements are commonly used to characterise iterable behaviours in abstract models of computation. Therefore, given a monoid M , it is natural to ask how long a sequence of elements of M needs to be to ensure the presence of consecutive idempotent factors. This question is formalised through the notion of the Ramsey function R M associated to M, obtained by mapping every positive integer k to the minimal integer R M(k) such that every word u in M of length R M(k) contains k consecutive non empty factors that correspond to the same idempotent element of M . In this work, we study the behaviour of the Ramsey function R M by investigating the regular D length of M , defined as the largest size L(M) of a submonoid of M isomorphic to the set of natural numbers 1,2, ..., L(M) equipped with the Max operation. We show that the regular D length of M determines the degree of R M , by proving that k L(M) leq R M(k) leq (k M 4) L(M) . To allow applications of this result, we provide the value of the regular D length of diverse monoids. In particular, we prove that the full monoid of n times n Boolean matrices, which is used to express transition monoids of non deterministic automata, has a regular D length of frac n 2 n 2 2 .


Open World Compositional Zero Shot Learning. Compositional Zero Shot learning (CZSL) requires to recognize state object compositions unseen during training. In this work, instead of assuming prior knowledge about the unseen compositions, we operate in the open world setting, where the search space includes a large number of unseen compositions some of which might be unfeasible. In this setting, we start from the cosine similarity between visual features and compositional embeddings. After estimating the feasibility score of each composition, we use these scores to either directly mask the output space or as a margin for the cosine similarity between visual features and compositional embeddings during training. Our experiments on two standard CZSL benchmarks show that all the methods suffer severe performance degradation when applied in the open world setting. While our simple CZSL model achieves state of the art performances in the closed world scenario, our feasibility scores boost the performance of our approach in the open world setting, clearly outperforming the previous state of the art.


Self Supervised Contrastive Learning with Adversarial Perturbations for Robust Pretrained Language Models. This paper improves the robustness of the pretrained language model, BERT, against word substitution based adversarial attacks by leveraging self supervised contrastive learning with adversarial perturbations. One advantage of our method compared to previous works is that it is capable of improving model robustness without using any labels. Additionally, we also create an adversarial attack for word level adversarial training on BERT. The attack is efficient, allowing adversarial training for BERT on adversarial examples generated textit on the fly during training. Experimental results show that our method improves the robustness of BERT against four different word substitution based adversarial attacks. Additionally, combining our method with adversarial training gives higher robustness than adversarial training alone. Furthermore, to understand why our method can improve the model robustness against adversarial attacks, we study vector representations of clean examples and their corresponding adversarial examples before and after applying our method. As our method improves model robustness with unlabeled raw data, it opens up the possibility of using large text datasets to train robust language models.


Bandcoin Using Smart Contracts to Automate Mobile Network Bandwidth Roaming Agreements. We propose a new way to share licensed spectrum bandwidth capacity in mobile networks between operators, service providers and consumers using blockchain based smart contracts. We discuss the foundational building blocks in the contract as well as various extensions to support more advanced features such as bulk purchases, future reservations, and various auction mechanisms. Furthermore, we demonstrate how the system can be implemented with an open source, permissioned Enterprise blockchain, Hyperledger Sawtooth. We show that our smart contract implementation can improve blockchain transaction performance, by approximately four orders of magnitude compared to serial transactions and one order of magnitude compared to parallell transactions, using PKI driven bulk purchases of mobile access grants, paving the way for fully automated, efficient, and fine grained roaming agreements.


Conversational Agents in Therapeutic Interventions for Neurodevelopmental Disorders A Survey. Neurodevelopmental Disorders (NDD) are a group of conditions with onset in the developmental period characterized by deficits in the cognitive and social areas. Conversational agents have been increasingly explored to support therapeutic interventions for people with NDD. This survey provides a structured view of the crucial design features of these systems, the types of therapeutic goals they address, and the empirical methods adopted for their evaluation. From this analysis, we elaborate a set of recommendations and highlight the gaps left unsolved in the state of the art, upon which we ground a research agenda on conversational agents for NDD.


First Proof of Concept Prototype of an Additive Manufactured Radio Frequency Quadrupole. Continuous developments in Additive Manufacturing (AM) technologies are opening opportunities in novel machining, and improving design alternatives for modern particle accelerator components. One of the most critical, complex, and delicate accelerator elements to manufacture and assemble is the Radio Frequency Quadrupole (RFQ) linear accelerator, used as an injector for all large modern proton and ion accelerator systems. For this reason, the RFQ has been selected by a wide European collaboration participating in the AM developments of the I.FAST (Innovation Fostering in Accelerator Science and Technology) Horizon 2020 project. RFQ is as an excellent candidate to show how sophisticated pure copper accelerator components can be manufactured by AM and how their functionalities can be boosted by this evolving technology. To show the feasibility of the AM process, a prototype RFQ section has been designed, corresponding to one quarter of a 750 MHz 4 vane RFQ, which was optimised for production with state of art Laser Powder Bed Fusion (L PBF) technology, and then manufactured in pure copper. To the best knowledge of the authors, this is the first RFQ section manufactured in the world by AM. Subsequently, geometrical precision and surface roughness of the prototype were measured. The results obtained are encouraging and confirm the feasibility of AM manufactured high tech accelerator components. It has been also confirmed that the RFQ geometry, in particular the critical electrode modulation and the complex cooling channels, can be successfully realised thanks to the opportunities provided by the AM technology. Further prototypes will aim to improve surface roughness and to test vacuum properties. In parallel, laboratory measurements will start to test and improve the voltage holding properties of AM manufactured electrode samples.


Support Optimality and Adaptive Cuckoo Filters. Filters (such as Bloom Filters) are data structures that speed up network routing and measurement operations by storing a compressed representation of a set. Filters are space efficient, but can make bounded one sided errors with tunable probability epsilon, they may report that a query element is stored in the filter when it is not. This is called a false positive. Recent research has focused on designing methods for dynamically adapting filters to false positives, reducing the number of false positives when some elements are queried repeatedly. Ideally, an adaptive filter would incur a false positive with bounded probability epsilon for each new query element, and would incur o(epsilon) total false positives over all repeated queries to that element. We call such a filter support optimal. In this paper we design a new Adaptive Cuckoo Filter and show that it is support optimal (up to additive logarithmic terms) over any n queries when storing a set of size n. Our filter is simple fixing previous false positives requires a simple cuckoo operation, and the filter does not need to store any additional metadata. This data structure is the first practical data structure that is support optimal, and the first filter that does not require additional space to fix false positives. We complement these bounds with experiments showing that our data structure is effective at fixing false positives on network traces, outperforming previous Adaptive Cuckoo Filters. Finally, we investigate adversarial adaptivity, a stronger notion of adaptivity in which an adaptive adversary repeatedly queries the filter, using the result of previous queries to drive the false positive rate as high as possible. We prove a lower bound showing that a broad family of filters, including all known Adaptive Cuckoo Filters, can be forced by such an adversary to incur a large number of false positives.


A Subexponential Algorithm for ARRIVAL. The ARRIVAL problem is to decide the fate of a train moving along the edges of a directed graph, according to a simple (deterministic) pseudorandom walk. The problem is in NP cap coNP but not known to be in P . The currently best algorithms have runtime 2 Theta(n) where n is the number of vertices. This is not much better than just performing the pseudorandom walk. We develop a subexponential algorithm with runtime 2 O( sqrt n log n) . We also give a polynomial time algorithm if the graph is almost acyclic. Both results are derived from a new general approach to solve ARRIVAL instances.


Chat Room Using HTML, PHP, CSS, JS, AJAX. Earlier there was no mode of online communication between users. In big or small organizations communication between users posed a challenge. There was a requirement to record these communications and store the data for further evaluation. The idea is to automate the existing Simple Chat Room system and make the users utilize the software so that their valuable information is stored digitally and can be retrieved for further management purposes. There was no online method of communicating with different users. There were many different interfaces available in the market but this method of using windows sockets to communicate between nodes would be fast and reliable. The main objective of our Simple Chat Room project is to create a chat application that helps different users to communicate with each other through a server connected. This is a simple chat program with a server and can have many clients. The server needs to be started first and clients can be connected later. Simple Chat Room provides bidirectional communication between client and server. It enables users to seamlessly communicate with each other. The user can chat using this chat application. If the user at the other end is active then they can start a chat session. The chat is recorded in this application.


The Stiefel Whitney classes of moment angle manifolds are trivial. We prove that the Stiefel Whitney classes of a moment angle manifold, not necessarily smooth, are trivial. We also consider Stiefel Whitney classes of the partial quotient of a moment angle manifold.


Ricci curvature, graphs and eigenvalues. We express the discrete Ricci curvature of a graph as the minimal eigenvalue of a family of matrices, one for each vertex of a graph whose entries depend on the local adjaciency structure of the graph. Using this method we compute or bound the Ricci curvature of Cayley graphs of finite Coxeter groups and affine Weyl groups. As an application we obtain an isoperimetric inequality that holds for all Cayley graphs of finite Coxeter groups.


Code Word Detection in Fraud Investigations using a Deep Learning Approach. In modern litigation, fraud investigators often face an overwhelming number of documents that must be reviewed throughout a matter. In the majority of legal cases, fraud investigators do not know beforehand, exactly what they are looking for, nor where to find it. In addition, fraudsters may use deception to hide their behaviour and intentions by using code words. Effectively, this means fraud investigators are looking for a needle in the haystack without knowing what the needle looks like. As part of a larger research program, we use a framework to expedite the investigation process applying text mining and machine learning techniques. We structure this framework using three well known methods in fraud investigations (i) the fraud triangle (ii) the golden ("W") investigation questions, and (iii) the analysis of competing hypotheses. With this framework, it is possible to automatically organize investigative data, so it is easier for investigators to find answers to typical investigative questions. In this research, we focus on one of the components of this framework the identification of the usage of code words by fraudsters. Here for, a novel (annotated) synthetic data set is created containing such code words, hidden in normal email communication. Subsequently, a range of machine learning techniques are employed to detect such code words. We show that the state of the art BERT model significantly outperforms other methods on this task. With this result, we demonstrate that deep neural language models can reliably (F1 score of 0.9) be applied in fraud investigations for the detection of code words.


Finding Cortical Subregions Regarding the Dorsal Language Pathway Based on the Structural Connectivity. Although the language related fiber pathways in the human brain, such as superior longitudinal fasciculus (SLF) and arcuate fasciculus (AF), are already well known, understanding more sophisticated cortical regions connected by the fiber tracts is essential to scrutinizing the structural connectivity of language circuits. With the regions of interest that were selected based on the Brainnetome atlas, the fiber orientation distribution estimation method for tractography was used to produce further elaborate connectivity information. The results indicated that both fiber bundles had two distinct connections with the prefrontal corte (PFC). The SLF II and dorsal AF are mainly connected to the rostrodorsal part of the inferior parietal cortex (IPC) and lateral part of the fusiform gyrus with the inferior frontal junction (IFJ), respectively. In contrast, the SLF III and ventral AF were primary linked to the anterior part of the supramarginal gyrus and superior part of the temporal cortex with the inferior frontal cortex, including the Broca's area. Moreover, the IFJ in the PFC, which has rarely been emphasized as a language related subretion, also had the strongest connectivity with the previously known language related subregions among the PFC consequently, we proposed that these specific regions are interconnected via the SLF and AF within the PFC, IPC, and temporal cortex as language related circuitry.


Free space optical communication receiver based on a spatial demultiplexer and a photonic integrated coherent combining circuit. Atmospheric turbulences can generate scintillation or beam wandering phenomena that impairs free space optical (FSO) communication. In this paper, we propose and demonstrate a proof of concept FSO communication receiver based on a spatial demultiplexer and a photonic integrated circuit coherent combiner. The system collects the light from several Hermite Gauss spatial modes and coherently combine on chip the energy from the different modes into a single output. The FSO receiver is characterized with a wavefront emulator bench that generates arbitrary phase and intensity patterns. The multimode receiver presents a strong resilience to wavefront distortions, compared to a monomode FSO receiver. The system is then used to detect a modulation of the optical beam through a random wavefront profile.


Bohr radius for Banach spaces on simply connected domains. Let H infty ( Omega,X) be the space of bounded analytic functions f(z) sum n 0 infty x n z n from a proper simply connected domain Omega containing the unit disk mathbb D z in mathbb C z 1 into a complex Banach space X with norm f H infty ( Omega,X) leq 1 . Let phi phi n (r) n 0 infty with phi 0 (r) leq 1 such that sum n 0 infty phi n (r) converges locally uniformly with respect to r in 0,1) . For 1 leq p,q infty , we denote begin equation R p,q, phi (f, Omega,X) sup left r geq 0 norm x 0 p phi 0 (r) left( sum n 1 infty norm x n phi n (r) right) q leq phi 0 (r) right end equation and define the Bohr radius associated with phi by R p,q, phi ( Omega,X) inf left R p,q, phi (f, Omega,X) norm f H infty ( Omega,X) leq 1 right . In this article, we extensively study the Bohr radius R p,q, phi ( Omega,X) , when X is an arbitrary Banach space and X is certain Hilbert space. Furthermore, we establish the Bohr inequality for the operator valued Ces ' a ro operator and Bernardi operator.


A note on the weak regularity theory for degenerate Kolmogorov equations. The aim of this work is to prove a Harnack inequality and the H "older continuity for weak solutions to the Kolmogorov equation mathscr L u f with measurable coefficients, integrable lower order terms and nonzero source term. We introduce a functional space mathcal W , suitable for the study of weak solutions to mathscr L u f , that allows us to prove a weak Poincar 'e inequality. More precisely, our goal is to prove a weak Harnack inequality for non negative super solutions by considering their Log transform and following S. N. Kruzkov (1963). Then this functional inequality is combined with a classical covering argument (Ink Spots Theorem) that we extend for the fist time to the case of ultraparabolic equations.


Duality for optimal couplings in free probability. We study the free probabilistic analog of optimal couplings for the quadratic cost, where classical probability spaces are replaced by tracial von Neumann algebras and probability measures on mathbb R m are replaced by non commutative laws of m tuples. We prove an analog of the Monge Kantorovich duality which characterizes optimal couplings of non commutative laws with respect to Biane and Voiculescu's non commutative L 2 Wasserstein distance using a new type of convex functions. As a consequence, we show that if (X,Y) is a pair of optimally coupled m tuples of non commutative random variables in a tracial mathrm W algebra mathcal A , then mathrm W ((1 t)X tY) mathrm W (X,Y) for all t in (0,1) . Finally, we illustrate the subtleties of non commutative optimal couplings through connections with results in quantum information theory and operator algebras. For instance, two non commutative laws that can be realized in finite dimensional algebras may still require an infinite dimensional algebra to optimally couple. Moreover, the space of non commutative laws of m tuples is not separable with respect to the Wasserstein distance for m 1 .


Influence of Furnace Baking on Q E Behavior of Superconducting Accelerating Cavities. The performance of superconducting radio frequency (SRF) cavities depends on the niobium surface condition. Recently, various heat treatment methods have been investigated to achieve unprecedented high quality factor (Q) and high accelerating field (E). We report the influence of a new baking process called furnace baking on the Q E behavior of 1.3 GHz SRF cavities. Furnace baking is performed as the final step of the cavity surface treatment the cavities are heated in a vacuum furnace for 3 h, followed by high pressure rinsing and radio frequency measurement. This method is simpler and potentially more reliable than previously reported heat treatment methods, and it is therefore, easier to apply to the SRF cavities. We find that the quality factor is increased after furnace baking at temperatures ranging from 300C to 400C, while strong decreasing the quality factor at high accelerating field is observed after furnace baking at temperatures ranging from 600C to 800C. We find significant differences in the surface resistance for various processing temperatures.


On generation of the coefficient field of a primitive Hilbert modular form by a single Fourier coefficient. For a primitive Hilbert modular form f over F of weight k , under certain assumptions on image of bar rho f, lambda , we calculate the Dirichlet density of primes mathfrak p for which the mathfrak p th Fourier coefficient C( mathfrak p , f) generates the coefficient field E f . If k 2 , then we show that the assumption on the image of bar rho f, lambda is satisfied when the degrees of E f, F are equal and odd prime. We also compute the density of primes mathfrak p for which C ( mathfrak p , f) generates F f . Then, we provide some examples of f to support our results. Finally, we calculate the density of primes mathfrak p for which C( mathfrak p , f) in K for any field K with F f subseteq K subseteq E f . This density is completely determined by the inner twists of f associated with K . This work can be thought of as a generalization of cite KSW08 to primitive Hilbert modular forms.


Planning on a (Risk) Budget Safe Non Conservative Planning in Probabilistic Dynamic Environments. Planning in environments with other agents whose future actions are uncertain often requires compromise between safety and performance. Here our goal is to design efficient planning algorithms with guaranteed bounds on the probability of safety violation, which nonetheless achieve non conservative performance. To quantify a system's risk, we define a natural criterion called interval risk bounds (IRBs), which provide a parametric upper bound on the probability of safety violation over a given time interval or task. We present a novel receding horizon algorithm, and prove that it can satisfy a desired IRB. Our algorithm maintains a dynamic risk budget which constrains the allowable risk at each iteration, and guarantees recursive feasibility by requiring a safe set to be reachable by a contingency plan within the budget. We empirically demonstrate that our algorithm is both safer and less conservative than strong baselines in two simulated autonomous driving experiments in scenarios involving collision avoidance with other vehicles, and additionally demonstrate our algorithm running on an autonomous class 8 truck.


An example of a simple double Lie algebra. We extend the correspondence between double Lie algebras and skew symmetric Rota Baxter operators of weight 0 on the matrix algebra for the infinite dimensional case. We give the first example of a simple double Lie algebra.


Multidimensional fully adaptive lattice Boltzmann methods with error control based on multiresolution analysis. Lattice Boltzmann methods are known for their simplicity, efficiency and ease of parallelization, usually relying on uniform Cartesian meshes with a strong bond between spatial and temporal discretization. This fact complicates the crucial issue of reducing the computational cost and the memory impact by automatically coarsening the grid where a fine mesh is unnecessary, still ensuring the overall quality of the numerical solution through error control. This work provides a possible answer to this interesting question, by connecting, for the first time, the field of lattice Boltzmann Methods (LBM) to the adaptive multiresolution (MR) approach based on wavelets. To this end, we employ a MR multi scale transform to adapt the mesh as the solution evolves in time according to its local regularity. The collision phase is not affected due to its inherent local nature and because we do not modify the speed of the sound, contrarily to most of the LBM Adaptive Mesh Refinement (AMR) strategies proposed in the literature, thus preserving the original structure of any LBM scheme. Besides, an original use of the MR allows the scheme to resolve the proper physics by efficiently controlling the accuracy of the transport phase. We carefully test our method to conclude on its adaptability to a wide family of existing lattice Boltzmann schemes, treating both hyperbolic and parabolic systems of equations, thus being less problem dependent than the AMR approaches, which have a hard time guaranteeing an effective control on the error. The ability of the method to yield a very efficient compression rate and thus a computational cost reduction for solutions involving localized structures with loss of regularity is also shown, while guaranteeing a precise control on the approximation error introduced by the spatial adaptation of the grid. The numerical strategy is implemented on a specific open source platform called SAMURAI with a dedicated data structure relying on set algebra.


Intrinsic Harmonic Spaces A Solution to the Ancient Problem of Perfect Tuning. In this article we solve this ancient problem of perfect tuning in all keys and present a system were all harmonies are conserved at once. It will become clear, when we expose our solution, why this solution could not be found in the way in which earlier on musicians and scientist have been approaching the problem. We follow indeed a different approach. We first construct a mathematical representation of the complete harmony by means of a vector space, where the different tones are represented in complete harmonic way for all keys at once. One of the essential differences with earlier systems is that tones will no longer be ordered within an octave, and we find the octave like ordering back as a projection of our system. But it is exactly by this projection procedure that the possibility to create a harmonic system for all keys at once is lost. So we see why the old way of ordering tones within an octave could not lead to a solution of the problem. We indicate in which way a real musical instrument could be built that realizes our harmonic scheme. Because tones are no longer ordered within an octave such a musical instrument will be rather unconventional. It is however a physically realizable musical instrument, at least for the Pythagorean harmony. We also indicate how perfect harmonies of every dimension could be realized by computers.


Benchmark Problems for CEC2021 Competition on Evolutionary Transfer Multiobjectve Optimization. Evolutionary transfer multiobjective optimization (ETMO) has been becoming a hot research topic in the field of evolutionary computation, which is based on the fact that knowledge learning and transfer across the related optimization exercises can improve the efficiency of others. Besides, the potential for transfer optimization is deemed invaluable from the standpoint of human like problem solving capabilities where knowledge gather and reuse are instinctive. To promote the research on ETMO, benchmark problems are of great importance to ETMO algorithm analysis, which helps designers or practitioners to understand the merit and demerit better of ETMO algorithms. Therefore, a total number of 40 benchmark functions are proposed in this report, covering diverse types and properties in the case of knowledge transfer, such as various formulation models, various PS geometries and PF shapes, large scale of variables, dynamically changed environment, and so on. All the benchmark functions have been implemented in JAVA code, which can be downloaded on the following website https github.com songbai liu etmo.


F3SNet A Four Step Strategy for QIM Steganalysis of Compressed Speech Based on Hierarchical Attention Network. Traditional machine learning based steganalysis methods on compressed speech have achieved great success in the field of communication security. However, previous studies lacked mathematical description and modeling of the correlation between codewords, and there is still room for improvement in steganalysis for small sized and low embedding rates sample. To deal with the challenge, We use Bayesian networks to measure different types of correlations between codewords in linear prediction code and present F3SNet a four step strategy Embedding, Encoding, Attention and Classification for quantizaition index modulation steganalysis of compressed speech based on Hierarchical Attention Network. Among them, Embedding converts codewords into high density numerical vectors, Encoding uses the memory characteristics of LSTM to retain more information by distributing it among all its vectors and Attention further determines which vectors have a greater impact on the final classification result. To evaluate the performance of F3SNet, we make comprehensive comparison of F3SNet with existing steganography methods. Experimental results show that F3SNet surpasses the state of the art methods, particularly for small sized and low embedding rate samples.


Federated Double Deep Q learning for Joint Delay and Energy Minimization in IoT networks. In this paper, we propose a federated deep reinforcement learning framework to solve a multi objective optimization problem, where we consider minimizing the expected long term task completion delay and energy consumption of IoT devices. This is done by optimizing offloading decisions, computation resource allocation, and transmit power allocation. Since the formulated problem is a mixed integer non linear programming (MINLP), we first cast our problem as a multi agent distributed deep reinforcement learning (DRL) problem and address it using double deep Q network (DDQN), where the actions are offloading decisions. The immediate cost of each agent is calculated through solving either the transmit power optimization or local computation resource optimization, based on the selected offloading decisions (actions). Then, to enhance the learning speed of IoT devices (agents), we incorporate federated learning (FDL) at the end of each episode. FDL enhances the scalability of the proposed DRL framework, creates a context for cooperation between agents, and minimizes their privacy concerns. Our numerical results demonstrate the efficacy of our proposed federated DDQN framework in terms of learning speed compared to federated deep Q network (DQN) and non federated DDQN algorithms. In addition, we investigate the impact of batch size, network layers, DDQN target network update frequency on the learning speed of the FDL.


On The Number of Different Entries in Involutory MDS Matrices over Finite Fields of Characteristic Two. Two of many criteria of a good MDS matrix are being involutory and having few different elements. This paper investigates the number of different entries in an involutory MDS matrices of order 1, 2, 3, and 4 over finite fields of characteristic two. There are at least three and four different elements in an involutory MDS matrices with, respectively, order three and four, over finite fields of characteristic two.


Full attention based Neural Architecture Search using Context Auto regression. Self attention architectures have emerged as a recent advancement for improving the performance of vision tasks. Manual determination of the architecture for self attention networks relies on the experience of experts and cannot automatically adapt to various scenarios. Meanwhile, neural architecture search (NAS) has significantly advanced the automatic design of neural architectures. Thus, it is appropriate to consider using NAS methods to discover a better self attention architecture automatically. However, it is challenging to directly use existing NAS methods to search attention networks because of the uniform cell based search space and the lack of long term content dependencies. To address this issue, we propose a full attention based NAS method. More specifically, a stage wise search space is constructed that allows various attention operations to be adopted for different layers of a network. To extract global features, a self supervised search algorithm is proposed that uses context auto regression to discover the full attention architecture. To verify the efficacy of the proposed methods, we conducted extensive experiments on various learning tasks, including image classification, fine grained image recognition, and zero shot image retrieval. The empirical results show strong evidence that our method is capable of discovering high performance, full attention architectures while guaranteeing the required search efficiency.


Computing Policies That Account For The Effects Of Human Agent Uncertainty During Execution In Markov Decision Processes. When humans are given a policy to execute, there can be policy execution errors and deviations in policy if there is uncertainty in identifying a state. This can happen due to the human agent's cognitive limitations and or perceptual errors. So an algorithm that computes a policy for a human to execute ought to consider these effects in its computations. An optimal Markov Decision Process (MDP) policy that is poorly executed (because of a human agent) maybe much worse than another policy that is suboptimal in the MDP, but considers the human agent's execution behavior. In this paper we consider two problems that arise from state uncertainty these are erroneous state inference, and extra sensing actions that a person might take as a result of their uncertainty. We present a framework to model the human agent's behavior with respect to state uncertainty, and can be used to compute MDP policies that accounts for these problems. This is followed by a hill climbing algorithm to search for good policies given our model of the human agent. We also present a branch and bound algorithm which can find the optimal policy for such problems. We show experimental results in a Gridworld domain, and warehouse worker domain. Finally, we present human subject studies that support our human model assumptions.


Evaluating the Single Shot MultiBox Detector and YOLO Deep Learning Models for the Detection of Tomatoes in a Greenhouse. The development of robotic solutions for agriculture requires advanced perception capabilities that can work reliably in any crop stage. For example, to automatise the tomato harvesting process in greenhouses, the visual perception system needs to detect the tomato in any life cycle stage (flower to the ripe tomato). The state of the art for visual tomato detection focuses mainly on ripe tomato, which has a distinctive colour from the background. This paper contributes with an annotated visual dataset of green and reddish tomatoes. This kind of dataset is uncommon and not available for research purposes. This will enable further developments in edge artificial intelligence for in situ and in real time visual tomato detection required for the development of harvesting robots. Considering this dataset, five deep learning models were selected, trained and benchmarked to detect green and reddish tomatoes grown in greenhouses. Considering our robotic platform specifications, only the Single Shot MultiBox Detector (SSD) and YOLO architectures were considered. The results proved that the system can detect green and reddish tomatoes, even those occluded by leaves. SSD MobileNet v2 had the best performance when compared against SSD Inception v2, SSD ResNet 50, SSD ResNet 101 and YOLOv4 Tiny, reaching an F1 score of 66.15 , an mAP of 51.46 and an inference time of 16.44 ms with the NVIDIA Turing Architecture platform, an NVIDIA Tesla T4, with 12 GB. YOLOv4 Tiny also had impressive results, mainly concerning inferring times of about 5 ms.


Task Oriented Dialogue System as Natural Language Generation. In this paper, we propose to formulate the task oriented dialogue system as the purely natural language generation task, so as to fully leverage the large scale pre trained models like GPT 2 and simplify complicated delexicalization prepossessing. However, directly applying this method heavily suffers from the dialogue entity inconsistency caused by the removal of delexicalized tokens, as well as the catastrophic forgetting problem of the pre trained model during fine tuning, leading to unsatisfactory performance. To alleviate these problems, we design a novel GPT Adapter CopyNet network, which incorporates the lightweight adapter and CopyNet modules into GPT 2 to achieve better performance on transfer learning and dialogue entity generation. Experimental results conducted on the DSTC8 Track 1 benchmark and MultiWOZ dataset demonstrate that our proposed approach significantly outperforms baseline models with a remarkable performance on automatic and human evaluations.


A 3D Advancing Front Delaunay Mesh Refinement Algorithm. I present a 3D advancing front mesh refinement algorithm that generates a constrained Delaunay mesh for any piecewise linear complex (PLC) and extend this algorithm to produce truly Delaunay meshes for any PLC. First, as in my recently published 2D algorithm, I split the input line segments such that the length of the subsegments is asymptotically proportional to the local feature size (LFS). For each facet, I refine the mesh such that the edge lengths and the radius of the circumcircle of every triangular element are asymptotically proportional to the LFS. Finally, I refine the volume mesh to produce a constrained Delaunay mesh whose tetrahedral elements are well graded and have a radius edge ratio less than some omega 2 sqrt 3 (except near'' small input angles). I extend this algorithm to generate truly Delaunay meshes by ensuring that every triangular element on a facet satisfies Gabriel's condition, i.e., its diametral sphere is empty. On an apex'' vertex where multiple facets intersect, Gabriel's condition is satisfied by a modified split on a sphere (SOS) technique. On a line where multiple facets intersect, Gabriel's condition is satisfied by mirroring meshes near the line of intersection. The SOS technique ensures that the triangles on a facet near the apex vertex have angles that are proportional to the angular feature size (AFS), a term I define in the paper. All tetrahedra (except near'' small input angles) are well graded and have a radius edge ratio less than omega sqrt 2 for a truly Delaunay mesh. The upper bounds for the radius edge ratio are an improvement by a factor of sqrt 2 over current state of the art algorithms.


Certifiable Machine Unlearning for Linear Models. Machine unlearning is the task of updating machine learning (ML) models after a subset of the training data they were trained on is deleted. Methods for the task are desired to combine effectiveness and efficiency, i.e., they should effectively "unlearn" deleted data, but in a way that does not require excessive computation effort (e.g., a full retraining) for a small amount of deletions. Such a combination is typically achieved by tolerating some amount of approximation in the unlearning. In addition, laws and regulations in the spirit of "the right to be forgotten" have given rise to requirements for certifiability, i.e., the ability to demonstrate that the deleted data has indeed been unlearned by the ML model. In this paper, we present an experimental study of the three state of the art approximate unlearning methods for linear models and demonstrate the trade offs between efficiency, effectiveness and certifiability offered by each method. In implementing the study, we extend some of the existing works and describe a common ML pipeline to compare and evaluate the unlearning methods on six real world datasets and a variety of settings. We provide insights into the effect of the quantity and distribution of the deleted data on ML models and the performance of each unlearning method in different settings. We also propose a practical online strategy to determine when the accumulated error from approximate unlearning is large enough to warrant a full retrain of the ML model.


Compactness Characterizations of Commutators on Ball Banach Function Spaces. Let X be a ball Banach function space on mathbb R n . Let Omega be a Lipschitz function on the unit sphere of mathbb R n ,which is homogeneous of degree zero and has mean value zero, and let T Omega be the convolutional singular integral operator with kernel Omega( cdot) cdot n . In this article, under the assumption that the Hardy Littlewood maximal operator mathcal M is bounded on both X and its associated space, the authors prove that the commutator b,T Omega is compact on X if and only if b in rm CMO ( mathbb R n) . To achieve this, the authors mainly employ three key tools some elaborate estimates, given in this article, on the norm in X of the commutators and the characteristic functions of some measurable subset,which are implied by the assumed boundedness of mathcal M on X and its associated space as well as the geometry of mathbb R n the complete John Nirenberg inequality in X obtained by Y. Sawano et al. the generalized Fr ' e chet Kolmogorov theorem on X also established in this article. All these results have a wide range of applications. Particularly, even when X L p( cdot) ( mathbb R n) (the variable Lebesgue space), X L vec p ( mathbb R n) (the mixed norm Lebesgue space), X L Phi( mathbb R n) (the Orlicz space), and X (E Phi q) t( mathbb R n) (the Orlicz slice space or the generalized amalgam space), all these results are new.


Controllable Dialogue Generation with Disentangled Multi grained Style Specification and Attribute Consistency Reward. Controllable text generation is an appealing but challenging task, which allows users to specify particular attributes of the generated outputs. In this paper, we propose a controllable dialogue generation model to steer response generation under multi attribute constraints. Specifically, we define and categorize the commonly used control attributes into global and local ones, which possess different granularities of effects on response generation. Then, we significantly extend the conventional seq2seq framework by introducing a novel two stage decoder, which first uses a multi grained style specification layer to impose the stylistic constraints and determine word level control states of responses based on the attributes, and then employs a response generation layer to generate final responses maintaining both semantic relevancy to the contexts and fidelity to the attributes. Furthermore, we train our model with an attribute consistency reward to promote response control with explicit supervision signals. Extensive experiments and in depth analyses on two datasets indicate that our model can significantly outperform competitive baselines in terms of response quality, content diversity and controllability.


A Novel Approach to Detect Redundant Activity Labels For More Representative Event Logs. The insights revealed from process mining heavily rely on the quality of event logs. Activities extracted from healthcare information systems with the free text nature may lead to inconsistent labels. Such inconsistency would then lead to redundancy of activity labels, which refer to labels that have different syntax but share the same behaviours. The identifications of these labels from data driven process discovery are difficult and rely heavily on resource intensive human review. Existing work achieves low accuracy either redundant activity labels are in low occurrence frequency or the existence of numerical data values as attributes in event logs. However, these phenomena are commonly observed in healthcare information systems. In this paper, we propose an approach to detect redundant activity labels using control flow relations and numerical data values from event logs. Natural Language Processing is also integrated into our method to assess semantic similarity between labels, which provides users with additional insights. We have evaluated our approach through synthetic logs generated from the real life Sepsis log and a case study using the MIMIC III data set. The results demonstrate that our approach can successfully detect redundant activity labels. This approach can add value to the preprocessing step to generate more representative event logs for process mining tasks in the healthcare domain.


Maximal operators in nondoubling metric measure spaces. This is a revised version of the doctoral dissertation of the same title, written under the supervision of Professor Krzysztof Stempak in 2019. For general (possibly nondoubling) metric measure spaces various properties of the associated maximal operators, centered mathcal M rm c and noncentered mathcal M , are investigated. Chapter 1 is the introduction to the topic. In Chapter 2 the classification of possible interrelations between the occurrences of strong, weak, and restricted weak type inequalities for both mathcal M rm c and mathcal M simultaneously is given. In Chapter 3 a similar analysis for the so called modified maximal operators is performed. Chapter 4 is devoted to studying the boundedness of mathcal M rm c from L p,q to L p,r . In particular, for each fixed p in (1, infty) the classification of possible shapes of the sets Big Big( frac 1 q , frac 1 r Big) in 0,1 times 0,1 mathcal M rm c text is bounded from L p,q text to L p,r Big is given for the class of spaces satisfying a mild support assumption mu(X setminus rm supp ( mu)) 0 . The main result of Chapter 5 is the classification of possible interrelations between the spaces rm BMO p , p in 1, infty) . In Chapter 6 a dichotomy regarding the finiteness of maximal functions associated with doubling spaces is tested in general setting. As a result, each of the four configurations regarding its occurrence or not for mathcal M rm c and mathcal M is illustrated with a suitably chosen nondoubling space. Finally, Appendix contains a new elementary proof of the interpolation theorem for Lorentz spaces with the first parameter fixed and the second parameter varying among its natural range of admissibility.


Proper biharmonic maps and (2,1) harmonic morphisms from some wild geometries. In this work we construct a variety of new complex valued proper biharmonic maps and (2,1) harmonic morphisms on Riemannian manifolds with non trivial geometry. These are solutions to a non linear system of partial differential equations depending on the geometric data of the manifolds involved.


Constant Delay Lattice Train Schedules. The following geometric vehicle scheduling problem has been considered given continuous curves f 1, ldots, f n mathbb R rightarrow mathbb R 2 , find non negative delays t 1, ldots, t n minimizing max t 1, ldots, t n such that, for every distinct i and j and every time t , f j (t t j) f i (t t i) ell , where ell is a given safety distance. We study a variant of this problem where we consider trains (rods) of fixed length ell that move at constant speed and sets of train lines (tracks), each of which consisting of an axis parallel line segment with endpoints in the integer lattice mathbb Z d and of a direction of movement (towards infty or infty ). We are interested in upper bounds on the maximum delay we need to introduce on any line to avoid collisions, but more specifically on universal upper bounds that apply no matter the set of train lines. We show small universal constant upper bounds for d 2 and any given ell and also for d 3 and ell 1 . Through clique searching, we are also able to show that several of these upper bounds are tight.


Doubly Forced Anharmonic Oscillator Model for Floating Potential Fluctuations in DC Glow Discharge Plasma. The Floating Potential Fluctuations (FPF) observed in a dc glow discharge plasma powered with two sources is modeled using an anharmonic oscillator with two forcing terms. In the discharge system, one of the electrode is biased to a negative voltage source (i.e. cathode), and the second electrode is biased to a positive voltage source (i.e. anode), while the stainless steel vacuum chamber is grounded. The dc glow discharge plasma is generated by the application of negative voltage on the cathode with respect to the grounded chamber using one of the power supplies. On the application of positive voltage to the anode using second power supply results in formation of a potential structure on achieving the triggering criteria. This potential structure is referred as anodic double layer (ADL). The evolution of ADL is associated with FPF. Therefore, FPF is analyzed to characterize the ADL's dynamical features. In this work, the experimentally observed FPF compared with numerically obtained oscillations using an anharmonic oscillator model with two forcing terms. Each of these forcing terms are associated with the two power supplies used in the experiment. The experimentally and numerically obtained oscillations from the model are studied using phase space plot, FFT, Largest Lyapunov exponent (LLE). The dynamical features of oscillations obtained by the model show strong agreement with the experiment and can be extended for a description of complex systems driven by multiple forces.


Universal rigidity on the line, point order. We show that universal rigidity of a generic bar and joint framework (G,p) in the line depends on more than the ordering of the vertices. In particular, we construct examples of one dimensional generic frameworks with the same graph and ordering of the vertices, such that one is universally rigid and one is not. This answers, in the negative, a question of Jordan and Nguyen.


Tomlinson Harashima Precoding with Stream Combiners for MU MIMO with Rate Splitting. This paper introduces multiuser multiple input multiple output (MU MIMO) architectures based on non linear precoding and stream combining techniques using rate splitting (RS), where the transmitter often has only partial knowledge of the channel state information (CSI). In contrast to existing works, we consider deployments where the receivers may be equipped with multiple antennas. This allows us to employ linear combining techniques based on the Min Max, the maximum ratio and the minimum mean square error criteria along with Tomlinson Harashima precoders (THP) for RS based MU MIMO systems to enhance the sum rate performance. Moreover, we incorporate the Multi Branch (MB) concept into the RS architecture to further improve the sum rate performance. Closed form expressions for the signal to interference plus noise ratio and the sum rate at the receiver end are devised through statistical analysis. Simulation results show that the proposed RS THP schemes achieve better performance than conventional linear and THP precoders.


Archimedes' principle for ideal gas. We prove Archimedes' principle for a macroscopic ball in ideal gas consisting of point particles with non zero mass. The main result is an asymptotic theorem, as the number of point particles goes to infinity and their total mass remains constant. We also show that, asymptotically, the gas has an exponential density as a function of height. We find the asymptotic inverse temperature of the gas. We derive an accurate estimate of the volume of the phase space using the local central limit theorem.


Performance Analysis of CP2K Code for Ab Initio Molecular Dynamics. Using a realistic molecular catalyst system, we conduct scaling studies of ab initio molecular dynamics simulations using the CP2K code on both Intel Xeon CPU and NVIDIA V100 GPU architectures. We explore using process placement and affinity to gain additional performance improvements. We also use statistical methods to understand performance changes in spite of the variability in runtime for each molecular dynamics timestep. We found ideal conditions for CPU runs included at least four MPI ranks per node, bound evenly across each socket, and fully utilizing processing cores with one OpenMP thread per core, no benefit was shown from reserving cores for the system. The CPU only simulations scaled at 70 or more of the ideal scaling up to 10 compute nodes, after which the returns began to diminish more quickly. Simulations on a single 40 core node with two NVIDIA V100 GPUs for acceleration achieved over 3.7x speedup compared to the fastest single 36 core node CPU only version, and showed 13 speedup over the fastest time we achieved across five CPU only nodes.


Relative tilting theory in abelian categories I Auslander Buchweitz Reiten approximations theory in subcategories and cotorsion pairs. In this paper we introduce a special kind of relative resolutions and coresolutions associated to a pair of classes of objects in an abelian category. We will see that by studying this resolutions and coresolutions we get a generalization of the Auslander Buchweitz approximation theory. With this goal, new concepts as mathcal X complete pairs and mathcal X hereditary pairs are introduced as a generalization of complete and hereditary cotorsion pairs. Our main results will include a generalization of Salce's Lemma and Garcia Rozas's Lemma, among other classical results from Auslander Buchweitz and Auslander Reiten theory.


Cold Start Similar Artists Ranking with Gravity Inspired Graph Autoencoders. On an artist's profile page, music streaming services frequently recommend a ranked list of "similar artists" that fans also liked. However, implementing such a feature is challenging for new artists, for which usage data on the service (e.g. streams or likes) is not yet available. In this paper, we model this cold start similar artists ranking problem as a link prediction task in a directed and attributed graph, connecting artists to their top k most similar neighbors and incorporating side musical information. Then, we leverage a graph autoencoder architecture to learn node embedding representations from this graph, and to automatically rank the top k most similar neighbors of new artists using a gravity inspired mechanism. We empirically show the flexibility and the effectiveness of our framework, by addressing a real world cold start similar artists ranking problem on a global music streaming service. Along with this paper, we also publicly release our source code as well as the industrial graph data from our experiments.


Generating synthetic transactional profiles. Financial institutions use clients' payment transactions in numerous banking applications. Transactions are very personal and rich in behavioural patterns, often unique to individuals, which make them equivalent to personally identifiable information in some cases. In this paper, we generate synthetic transactional profiles using machine learning techniques with the goal to preserve both data utility and privacy. A challenge we faced was to deal with sparse vectors due to the few spending categories a client uses compared to all the ones available. We measured data utility by calculating common insights used by the banking industry on both the original and the synthetic data set. Our approach shows that neural network models can generate valuable synthetic data in such context. Finally, we tried privacy preserving techniques and observed its effect on models' performances.


Infrared spectroscopy of radioactive hydrogen chloride H 36 ! Cl. We present the first report of optical absorption spectroscopy of H 36 ! Cl, a radioactive isotopologue of hydrogen chloride. We used Fourier transform infrared spectroscopy to determine the line center wavenumbers of the fundamental rovibrational band lines P(10) R(10) and the first overtone band lines P(1) R(7) with total uncertainty of less than 0.0018 cm 1 (60 MHz) and 0.007 cm 1 (0.2 GHz), respectively, at 68 confidence level. We also performed a rotational analysis on the bands to determine the related molecular constants. We further compared the linewidths and relative intensities of the lines to those of the stable isotopologues H 35 ! Cl and H 37 ! Cl. The new spectroscopic information assists in developing optical instrumentation for the detection of H 36 ! Cl.


Cloud Collectives Towards Cloud aware Collectives forML Workloads with Rank Reordering. ML workloads are becoming increasingly popular in the cloud. Good cloud training performance is contingent on efficient parameter exchange among VMs. We find that Collectives, the widely used distributed communication algorithms, cannot perform optimally out of the box due to the hierarchical topology of datacenter networks and multi tenancy nature of the cloudenvironment.In this paper, we present Cloud Collectives , a prototype that accelerates collectives by reordering theranks of participating VMs such that the communication pattern dictated by the selected collectives operation best exploits the locality in the network.Collectives is non intrusive, requires no code changes nor rebuild of an existing application, and runs without support from cloud providers. Our preliminary application of Cloud Collectives on allreduce operations in public clouds results in a speedup of up to 3.7x in multiple microbenchmarks and 1.3x in real world workloads of distributed training of deep neural networks and gradient boosted decision trees using state of the art frameworks.


GestureMap Supporting Visual Analytics and Quantitative Analysis of Motion Elicitation Data by Learning 2D Embeddings. This paper presents GestureMap, a visual analytics tool for gesture elicitation which directly visualises the space of gestures. Concretely, a Variational Autoencoder embeds gestures recorded as 3D skeletons on an interactive 2D map. GestureMap further integrates three computational capabilities to connect exploration to quantitative measures Leveraging DTW Barycenter Averaging (DBA), we compute average gestures to 1) represent gesture groups at a glance 2) compute a new consensus measure (variance around average gesture) and 3) cluster gestures with k means. We evaluate GestureMap and its concepts with eight experts and an in depth analysis of published data. Our findings show how GestureMap facilitates exploring large datasets and helps researchers to gain a visual understanding of elicited gesture spaces. It further opens new directions, such as comparing elicitations across studies. We discuss implications for elicitation studies and research, and opportunities to extend our approach to additional tasks in gesture elicitation.


A Human Centered Dynamic Scheduling Architecture for Collaborative Application. In collaborative robotic applications, human and robot have to work together during a whole shift for executing a sequence of jobs. The performance of the human robot team can be enhanced by scheduling the right tasks to the human and the robot. The scheduling should consider the task execution constraints, the variability in the task execution by the human, and the job quality of the human. Therefore, it is necessary to dynamically schedule the assigned tasks. In this paper, we propose a two layered architecture for task allocation and scheduling in a collaborative cell. Job quality is explicitly considered during the allocation of the tasks and over a sequence of jobs. The tasks are dynamically scheduled based on the real time monitoring of the human's activities. The effectiveness of the proposed architecture is experimentally validated.


Catalytic synthesis of C 2 C 4 alkenes from dimethyl ether. In the study, the effect of the volumetric velocity of the initial gaseous mixture on the catalytic properties of Zn Zr Cu HSZ Al 2 O 3 in the conversion of dimethyl ether to olefins was studied. When the volumetric rate is increased by 5 times, the conversion of dimethyl ether decreases from 96.5 to 40.7 , the total selectivity for C 2 C 4 olefins decreases from 59.0 to 75.5 mas. , at the same time, the yield of the by products of the reaction C 2 paraffin is reduced. A decrease in the reaction temperature at the equal conversion of dimethyl ether leads to an increase in selectivity for both ethylene and propylene due to a decrease in the formation of methane and C 2 paraffin in the reaction products. Thus, in copper containing zeolite catalysts, lower olefins than dimethyl ether provide higher conversion of raw material and higher selectivity of olefin formation (up to 90 mas. .). Also, changing the initial raw material composition and regime parameters allows a significant change in the ratio of olefins to each other.


On the Arithmetic Fundamental Lemma conjecture over a general p adic field. We prove the arithmetic fundamental lemma conjecture over a general p adic field with odd residue cardinality q geq dim V . Our strategy is similar to the one used by the second author during his proof of the AFL over mathbb Q p (arXiv 1909.02697), but only requires the modularity of divisor generating series on the Shimura variety (as opposed to its integral model). The resulting increase in flexibility allows us to work over an arbitrary base field. To carry out the strategy, we also generalize results of Howard (arXiv 1303.0545) on CM cycle intersection and of Ehlen Sankaran (arXiv 1607.06545) on Green function comparison from mathbb Q to general totally real base fields.


On the Hermitian structures of the sequence of tangent bundles of an affine manifold endowed with a Riemannian metric. Let (M, nabla, langle , rangle) be a manifold endowed with a flat torsionless connection nabla and a Riemannian metric langle , rangle and (T kM) k geq1 the sequence of tangent bundles given by T kM T(T k 1 M) and T 1M TM . We show that, for any k geq1 , T kM carries a Hermitian structure (J k,g k) and a flat torsionless connection nabla k and when M is a Lie group and ( nabla, langle , rangle) are left invariant there is a Lie group structure on each T kM such that (J k,g k, nabla k) are left invariant. It is well known that (TM,J 1,g 1) is K "ahler if and only if langle , rangle is Hessian, i.e, in each system of affine coordinates (x 1, ldots,x n) , langle partial x i , partial x j rangle frac partial 2 phi partial x i partial x j . Having in mind many generalizations of the K "ahler condition introduced recently, we give the conditions on ( nabla, langle , rangle) so that (TM,J 1,g 1) is balanced, locally conformally balanced, locally conformally K "ahler, pluriclosed, Gauduchon, Vaismann or Calabi Yau with torsion. Moreover, we can control at the level of ( nabla, langle , rangle) the conditions insuring that some (T kM,J k,g k) or all of them satisfy a generalized K "ahler condition. For instance, we show that there are some classes of (M, nabla, langle , rangle) such that, for any k geq1 , (T kM,J k,g k) is balanced non K "ahler and Calabi Yau with torsion. By carefully studying the geometry of (M, nabla, langle , rangle) , we develop a powerful machinery to build a large classes of generalized K "ahler manifolds.


Low Latency Federated Learning over Wireless Channels with Differential Privacy. In federated learning (FL), model training is distributed over clients and local models are aggregated by a central server. The performance of uploaded models in such situations can vary widely due to imbalanced data distributions, potential demands on privacy protections, and quality of transmissions. In this paper, we aim to minimize FL training delay over wireless channels, constrained by overall training performance as well as each client's differential privacy (DP) requirement. We solve this problem in the framework of multi agent multi armed bandit (MAMAB) to deal with the situation where there are multiple clients confornting different unknown transmission environments, e.g., channel fading and interferences. Specifically, we first transform the long term constraints on both training performance and each client's DP into a virtual queue based on the Lyapunov drift technique. Then, we convert the MAMAB to a max min bipartite matching problem at each communication round, by estimating rewards with the upper confidence bound (UCB) approach. More importantly, we propose two efficient solutions to this matching problem, i.e., modified Hungarian algorithm and greedy matching with a better alternative (GMBA), in which the first one can achieve the optimal solution with a high complexity while the second one approaches a better trade off by enabling a verified low complexity with little performance loss. In addition, we develop an upper bound on the expected regret of this MAMAB based FL framework, which shows a linear growth over the logarithm of communication rounds, justifying its theoretical feasibility. Extensive experimental results are conducted to validate the effectiveness of our proposed algorithms, and the impacts of various parameters on the FL performance over wireless edge networks are also discussed.


Mixed Hegselmann Krause Dynamics II. The mixed Hegselmann Krause (HK) model consists of a finite number of agents characterized by their opinion, a vector in mathbf R d . For the deterministic case, each agent updates its opinion by the rule decide its degree of stubbornness and mix its opinion with the average opinion of its neighbors, the agents whose opinion differs by at most some confidence threshold from its opinion at each time step. The mixed model is studied deterministically in cite mHK . In this paper, we study it nondeterministically and involve a social relationship among the agents which can vary over time. We investigate circumstances under which asymptotic stability holds. Furthermore, we indicate the mixed model covers not only the HK model but also the Deffuant model.


Accurate online training of dynamical spiking neural networks through Forward Propagation Through Time. The event driven and sparse nature of communication between spiking neurons in the brain holds great promise for flexible and energy efficient AI. Recent advances in learning algorithms have demonstrated that recurrent networks of spiking neurons can be effectively trained to achieve competitive performance compared to standard recurrent neural networks. Still, as these learning algorithms use error backpropagation through time (BPTT), they suffer from high memory requirements, are slow to train, and are incompatible with online learning. This limits the application of these learning algorithms to relatively small networks and to limited temporal sequence lengths. Online approximations to BPTT with lower computational and memory complexity have been proposed (e prop, OSTL), but in practice also suffer from memory limitations and, as approximations, do not outperform standard BPTT training. Here, we show how a recently developed alternative to BPTT, Forward Propagation Through Time (FPTT) can be applied in spiking neural networks. Different from BPTT, FPTT attempts to minimize an ongoing dynamically regularized risk on the loss. As a result, FPTT can be computed in an online fashion and has fixed complexity with respect to the sequence length. When combined with a novel dynamic spiking neuron model, the Liquid Time Constant neuron, we show that SNNs trained with FPTT outperform online BPTT approximations, and approach or exceed offline BPTT accuracy on temporal classification tasks. This approach thus makes it feasible to train SNNs in a memory friendly online fashion on long sequences and scale up SNNs to novel and complex neural architectures.


Predicting the Directional Transport of Multivalent Cargo from Position Dependent Binding and Unbinding Rates. Multivalent cargo that can interact with substrates via multiple interaction sites exhibit shared characteristics despite being found in different systems at different length scales. Here, a general analytical model has been developed that can describe the motion of multivalent cargo as a response to position dependence in the binding and unbinding rates of their interaction sites. Cargo exhibit both an effective diffusivity and velocity, which acts in the direction of increasing cargo substrate binding rate and decreasing cargo substrate unbinding rate. This model can reproduce previously published experimental findings using only the binding and unbinding rate distributions of cargo interaction sites, and without any further parameter fitting. Extension of the cargo binding model to two dimensions reveals an effective velocity with the same properties as that derived for the 1 D case.


Multimodal Feature Fusion for Video Advertisements Tagging Via Stacking Ensemble. Automated tagging of video advertisements has been a critical yet challenging problem, and it has drawn increasing interests in last years as its applications seem to be evident in many fields. Despite sustainable efforts have been made, the tagging task is still suffered from several challenges, such as, efficiently feature fusion approach is desirable, but under explored in previous studies. In this paper, we present our approach for Multimodal Video Ads Tagging in the 2021 Tencent Advertising Algorithm Competition. Specifically, we propose a novel multi modal feature fusion framework, with the goal to combine complementary information from multiple modalities. This framework introduces stacking based ensembling approach to reduce the influence of varying levels of noise and conflicts between different modalities. Thus, our framework can boost the performance of the tagging task, compared to previous methods. To empirically investigate the effectiveness and robustness of the proposed framework, we conduct extensive experiments on the challenge datasets. The obtained results suggest that our framework can significantly outperform related approaches and our method ranks as the 1st place on the final leaderboard, with a Global Average Precision (GAP) of 82.63 . To better promote the research in this field, we will release our code in the final version.


Self Supervised Radio Visual Representation Learning for 6G Sensing. In future 6G cellular networks, a joint communication and sensing protocol will allow the network to perceive the environment, opening the door for many new applications atop a unified communication perception infrastructure. However, interpreting the sparse radio representation of sensing scenes is challenging, which hinders the potential of these emergent systems. We propose to combine radio and vision to automatically learn a radio only sensing model with minimal human intervention. We want to build a radio sensing model that can feed on millions of uncurated data points. To this end, we leverage recent advances in self supervised learning and formulate a new label free radio visual co learning scheme, whereby vision trains radio via cross modal mutual information. We implement and evaluate our scheme according to the common linear classification benchmark, and report qualitative and quantitative performance metrics. In our evaluation, the representation learnt by radio visual self supervision works well for a downstream sensing demonstrator, and outperforms its fully supervised counterpart when less labelled data is used. This indicates that self supervised learning could be an important enabler for future scalable radio sensing systems.


Reward Shaping with Subgoals for Social Navigation. Social navigation has been gaining attentions with the growth in machine intelligence. Since reinforcement learning can select an action in the prediction phase at a low computational cost, it has been formulated in a social navigation tasks. However, reinforcement learning takes an enormous number of iterations until acquiring a behavior policy in the learning phase. This negatively affects the learning of robot behaviors in the real world. In particular, social navigation includes humans who are unpredictable moving obstacles in an environment. We proposed a reward shaping method with subgoals to accelerate learning. The main part is an aggregation method that use subgoals to shape a reinforcement learning algorithm. We performed a learning experiment with a social navigation task in which a robot avoided collisions and then reached its goal. The experimental results show that our method improved the learning efficiency from a base algorithm in the task.


Optical Braille Recognition using Circular Hough Transform. Braille has empowered visually challenged community to read and write. But at the same time, it has created a gap due to widespread inability of non Braille users to understand Braille scripts. This gap has fuelled researchers to propose Optical Braille Recognition techniques to convert Braille documents to natural language. The main motivation of this work is to cement the communication gap at academic institutions by translating personal documents of blind students. This has been accomplished by proposing an economical and effective technique which digitizes Braille documents using a smartphone camera. For any given Braille image, a dot detection mechanism based on Hough transform is proposed which is invariant to skewness, noise and other deterrents. The detected dots are then clustered into Braille cells using distance based clustering algorithm. In succession, the standard physical parameters of each Braille cells are estimated for feature extraction and classification as natural language characters. The comprehensive evaluation of this technique on the proposed dataset of 54 Braille scripts has yielded into accuracy of 98.71 .


GDI Rethinking What Makes Reinforcement Learning Different From Supervised Learning. Deep Q Network (DQN) firstly kicked the door of deep reinforcement learning (DRL) via combining deep learning (DL) with reinforcement learning (RL), which has noticed that the distribution of the acquired data would change during the training process. DQN found this property might cause instability for training, so it proposed effective methods to handle the downside of the property. Instead of focusing on the unfavourable aspects, we find it critical for RL to ease the gap between the estimated data distribution and the ground truth data distribution while supervised learning (SL) fails to do so. From this new perspective, we extend the basic paradigm of RL called the Generalized Policy Iteration (GPI) into a more generalized version, which is called the Generalized Data Distribution Iteration (GDI). We see massive RL algorithms and techniques can be unified into the GDI paradigm, which can be considered as one of the special cases of GDI. We provide theoretical proof of why GDI is better than GPI and how it works. Several practical algorithms based on GDI have been proposed to verify the effectiveness and extensiveness of it. Empirical experiments prove our state of the art (SOTA) performance on Arcade Learning Environment (ALE), wherein our algorithm has achieved 9620.98 mean human normalized score (HNS), 1146.39 median HNS and 22 human world record breakthroughs (HWRB) using only 200M training frames. Our work aims to lead the RL research to step into the journey of conquering the human world records and seek real superhuman agents on both performance and efficiency.


Digital Resilience and the Continuance Use of Mobile Payment Services. The use of mobile payment services is an essential contributor to financial inclusion in emerging markets. Unfortunately, the service has become a platform for fraud. Mobile payment users need to be digitally resilient to continue using the service after adverse events. However, there is scant literature on users' continuance use of mobile payment services in the post event of fraud. The focal point of prior literature has been on technology adoption or threat avoidance to implement policies that protect users. Analysing the relationship between individual digital resilience and post adoption behavioural patterns will enable service providers to support individual digital resilience to promote users' continuance use of the service. This research aims to develop and empirically validate a conceptual model to examine individual digital resilience in the context of the continuance use of mobile payments. The model will be based on protection motivation theory. Survey data will be obtained from victims of mobile payment fraud and other users who continue using the service despite their knowledge of mobile payment fraud. The results from this study are expected to make key contributions to theory, practice, and policy in the areas of digital resilience, mobile payments, and ICT4D.


Verifying Verified Code. A recent case study from AWS by Chong et al. proposes an effective methodology for Bounded Model Checking in industry. In this paper, we report on a follow up case study that explores the methodology from the perspective of three research questions (a) can proof artifacts be used across verification tools (b) are there bugs in verified code and (c) can specifications be improved. To study these questions, we port the verification tasks for texttt aws c common library to SEAHORN and KLEE. We show the benefits of using compiler semantics and cross checking specifications with different verification techniques, and call for standardizing proof library extensions to increase specification reuse. The verification tasks discussed are publicly available online.


Attacks against Ranking Algorithms with Text Embeddings a Case Study on Recruitment Algorithms. Recently, some studies have shown that text classification tasks are vulnerable to poisoning and evasion attacks. However, little work has investigated attacks against decision making algorithms that use text embeddings, and their output is a ranking. In this paper, we focus on ranking algorithms for recruitment process, that employ text embeddings for ranking applicants resumes when compared to a job description. We demonstrate both white box and black box attacks that identify text items, that based on their location in embedding space, have significant contribution in increasing the similarity score between a resume and a job description. The adversary then uses these text items to improve the ranking of their resume among others. We tested recruitment algorithms that use the similarity scores obtained from Universal Sentence Encoder (USE) and Term Frequency Inverse Document Frequency (TF IDF) vectors. Our results show that in both adversarial settings, on average the attacker is successful. We also found that attacks against TF IDF is more successful compared to USE.


Learning Concept Lengths Accelerates Concept Learning in ALC. Concept learning approaches based on refinement operators explore partially ordered solution spaces to compute concepts, which are used as binary classification models for individuals. However, the number of concepts explored by these approaches can easily grow to the millions for complex learning problems. This often leads to impractical runtimes. We propose to alleviate this problem by predicting the length of target concepts before the exploration of the solution space. By these means, we can prune the search space during concept learning. To achieve this goal, we compare four neural architectures and evaluate them on four benchmarks. Our evaluation results suggest that recurrent neural network architectures perform best at concept length prediction with a macro F measure ranging from 38 to 92 . We then extend the CELOE algorithm which learns ALC concepts with our concept length predictor. Our extension yields the algorithm CLIP. In our experiments, CLIP is at least 7.5 times faster than other state of the art concept learning algorithms for ALC including CELOE and achieves significant improvements in the F measure of the concepts learned on 3 out of 4 datasets. For reproducibility, we provide our implementation in the public GitHub repository at https github.com ConceptLengthLearner LearnLengths


Tollmien Schlichting route to elastoinertial turbulence in channel flow. Direct simulations of two dimensional channel flow of a viscoelastic fluid have revealed the existence of a family of Tollmien Schlichting (TS) attractors that is nonlinearly self sustained by viscoelasticity Shekar et al., J.Fluid Mech. 893, A3 (2020) . Here, we describe the evolution of this branch in parameter space and its connections to the Newtonian TS attractor and to elastoinertial turbulence (EIT). At Reynolds number Re 3000 , there is a solution branch with TS wave structure but which is not connected to the Newtonian solution branch. At fixed Weissenberg number, Wi and increasing Reynolds number from 3000 10000, this attractor goes from displaying a striation of weak polymer stretch localized at the critical layer to an extended sheet of very large polymer stretch. We show that this transition is directly tied to the strength of the TS critical layer fluctuations and can be attributed to a coil stretch transition when the local Weissenberg number at the hyperbolic stagnation point of the Kelvin cat's eye structure of the TS wave exceeds frac 1 2 . At Re 10000 , unlike 3000 , the Newtonian TS attractor evolves continuously into the EIT state as Wi is increased from zero to about 13 . We describe how the structure of the flow and stress fields changes, highlighting in particular a "sheet shedding" process by which the individual sheets associated with the critical layer structure break up to form the layered multisheet structure characteristic of EIT.


The taut polynomial and the Alexander polynomial. Landry, Minsky and Taylor defined the taut polynomial of a veering triangulation. Its specialisations generalise the Teichmuller polynomial of a fibred face of the Thurston norm ball. We prove that the taut polynomial of a veering triangulation is equal to a certain twisted Alexander polynomial of the underlying manifold. Then we give formulas relating the taut polynomial and the untwisted Alexander polynomial. There are two formulas one holds when the maximal free abelian cover of a veering triangulation is edge orientable, another holds when it is not edge orientable. Furthermore, we consider 3 manifolds obtained by Dehn filling a veering triangulation. In this case we give a formula that relates the specialisation of the taut polynomial under the Dehn filling and the Alexander polynomial of the Dehn filled manifold. This extends a theorem of McMullen connecting the Teichmuller polynomial and the Alexander polynomial to the nonfibred setting, and improves it in the fibred case. We also prove a sufficient and necessary condition for the existence of an orientable fibred class in the cone over a fibred face of the Thurston norm ball.


ADAADepth Adapting Data Augmentation and Attention for Self Supervised Monocular Depth Estimation. Self supervised learning of depth has been a highly studied topic of research as it alleviates the requirement of having ground truth annotations for predicting depth. Depth is learnt as an intermediate solution to the task of view synthesis, utilising warped photometric consistency. Although it gives good results when trained using stereo data, the predicted depth is still sensitive to noise, illumination changes and specular reflections. Also, occlusion can be tackled better by learning depth from a single camera. We propose ADAA, utilising depth augmentation as depth supervision for learning accurate and robust depth. We propose a relational self attention module that learns rich contextual features and further enhances depth results. We also optimize the auto masking strategy across all losses by enforcing L1 regularisation over mask. Our novel progressive training strategy first learns depth at a lower resolution and then progresses to the original resolution with slight training. We utilise a ResNet18 encoder, learning features for prediction of both depth and pose. We evaluate our predicted depth on the standard KITTI driving dataset and achieve state of the art results for monocular depth estimation whilst having significantly lower number of trainable parameters in our deep learning framework. We also evaluate our model on Make3D dataset showing better generalization than other methods.


2.5 dimensional distributed model training. Data parallelism does a good job in speeding up the training. However, when it comes to the case when the memory of a single device can not host a whole model, data parallelism would not have the chance to do anything. Another option is to split the model by operator, or horizontally. Megatron LM introduced a 1 Dimensional distributed method to use GPUs to speed up the training process. Optimus is a 2D solution for distributed tensor parallelism. However, these methods have a high communication overhead and a low scaling efficiency on large scale computing clusters. To solve this problem, we investigate the 2.5 Dimensional distributed tensor parallelism.Introduced by Solomonik et al., 2.5 Dimensional Matrix Multiplication developed an effective method to perform multiple Cannon's algorithm at the same time to increase the efficiency. With many restrictions of Cannon's Algorithm and a huge amount of shift operation, we need to invent a new method of 2.5 dimensional matrix multiplication to enhance the performance. Absorbing the essence from both SUMMA and 2.5 Dimensional Matrix Multiplication, we introduced SUMMA2.5 LM for language models to overcome the abundance of unnecessary transmission loss result from the increasing size of language model parallelism. Compared to previous 1D and 2D model parallelization of language models, our SUMMA2.5 LM managed to reduce the transmission cost on each layer, which could get a 1.45X efficiency according to our weak scaling result between 2.5 D 4,4,4 arrangement and 2 D 8,8,1 arrangement.


FedNI Federated Graph Learning with Network Inpainting for Population Based Disease Prediction. Graph Convolutional Neural Networks (GCNs) are widely used for graph analysis. Specifically, in medical applications, GCNs can be used for disease prediction on a population graph, where graph nodes represent individuals and edges represent individual similarities. However, GCNs rely on a vast amount of data, which is challenging to collect for a single medical institution. In addition, a critical challenge that most medical institutions continue to face is addressing disease prediction in isolation with incomplete data information. To address these issues, Federated Learning (FL) allows isolated local institutions to collaboratively train a global model without data sharing. In this work, we propose a framework, FedNI, to leverage network inpainting and inter institutional data via FL. Specifically, we first federatively train missing node and edge predictor using a graph generative adversarial network (GAN) to complete the missing information of local networks. Then we train a global GCN node classifier across institutions using a federated graph learning platform. The novel design enables us to build more accurate machine learning models by leveraging federated learning and also graph learning approaches. We demonstrate that our federated model outperforms local and baseline FL methods with significant margins on two public neuroimaging datasets.


Construction of Side Channel Attacks Resistant S boxes using Genetic Algorithms based on Coordinate Functions. Background and Objectives Substitution box (s box) is one of the essential components to create confusion and nonlinear properties in cryptography. To strengthening a cipher against various attacks, including side channel attacks, these boxes need to have numerous security properties. In this paper, a novel method to generate s boxes is introduced aimed at improving the resistance of s boxes against side channel attacks. Methods In the preprocessing phase of this approach, a suitable initial s box which has some basic security properties is generated by adopting a fast algorithm. Then, in the main stage, using the initial s box, we generate new s boxes which not only have the properties of the initial S box but also have been significantly improved under another set of security properties. To do this, new s boxes are generated using a genetic algorithm on a particular subset of the linear combination set of coordinate functions of the initial s box in the preprocessing stage. Results The performed experiments demonstrate that the values of all security properties of these new s boxes, especially the measures of transparency order, signal to noise ratio, confusion coefficient, bijection property, fixed point, and opposite fixed points, have been substantially improved. For example, our experiments indicate that 70, 220, 2071, 43, and 406 s boxes are found better than the initial s box, respectively, in the dimensions of 4x4 through 8x8 Conclusion In this article, a new s box construction method is introduced in which the properties related to side channel attacks are improved, without reducing other security properties. Besides, some results obtained from generated s boxes in the dimensions of 4x4 through 8x8 demonstrated that the generated s boxes are not only improved relative to the initial s box, but in some cases, considerably better than some well known s boxes.