Constraint Aware Deep Reinforcement Learning for End to End Resource Orchestration in Mobile Networks. Network slicing is a promising technology that allows mobile network operators to efficiently serve various emerging use cases in 5G. It is challenging to optimize the utilization of network infrastructures while guaranteeing the performance of network slices according to service level agreements (SLAs). To solve this problem, we propose SafeSlicing that introduces a new constraint aware deep reinforcement learning (CaDRL) algorithm to learn the optimal resource orchestration policy within two steps, i.e., offline training in a simulated environment and online learning with the real network system. On optimizing the resource orchestration, we incorporate the constraints on the statistical performance of slices in the reward function using Lagrangian multipliers, and solve the Lagrangian relaxed problem via a policy network. To satisfy the constraints on the system capacity, we design a constraint network to map the latent actions generated from the policy network to the orchestration actions such that the total resources allocated to network slices do not exceed the system capacity. We prototype SafeSlicing on an end to end testbed developed by using OpenAirInterface LTE, OpenDayLight based SDN, and CUDA GPU computing platform. The experimental results show that SafeSlicing reduces more than 20 resource usage while meeting SLAs of network slices as compared with other solutions.


Coherence of Augmented Iwasawa Algebras. The augmented Iwasawa algebra of a p adic Lie group is a generalisation of the Iwasawa algebra of a compact p adic Lie group. We prove that a split semisimple group over a p adic field has a coherent augmented Iwasawa algebra if and only if its root system is of rank one. We also characterise when certain solvable p adic Lie groups have a coherent augmented Iwasawa algebra.


Introducing the Talk Markup Language (TalkML) Adding a little social intelligence to industrial speech interfaces. Virtual Personal Assistants like Siri have great potential but such developments hit the fundamental problem of how to make computational devices that understand human speech. Natural language understanding is one of the more disappointing failures of AI research and it seems there is something we computer scientists don't get about the nature of language. Of course philosophers and linguists think quite differently about language and this paper describes how we have taken ideas from other disciplines and implemented them. The background to the work is to take seriously the notion of language as action and look at what people actually do with language using the techniques of Conversation Analysis. The observation has been that human communication is (behind the scenes) about the management of social relations as well as the (foregrounded) passing of information. To claim this is one thing but to implement it requires a mechanism. The mechanism described here is based on the notion of language being intentional we think intentionally, talk about them and recognise them in others and cooperative in that we are compelled to help out. The way we are compelled points to a solution to the ever present problem of keeping the human on topic. The approach has led to a recent success in which we significantly improve user satisfaction independent of task completion. Talk Markup Language (TalkML) is a draft alternative to VoiceXML that, we propose, greatly simplifies the scripting of interaction by providing default behaviours for no input and not recognised speech events.


Object Retrieval and Localization in Large Art Collections using Deep Multi Style Feature Fusion and Iterative Voting. The search for specific objects or motifs is essential to art history as both assist in decoding the meaning of artworks. Digitization has produced large art collections, but manual methods prove to be insufficient to analyze them. In the following, we introduce an algorithm that allows users to search for image regions containing specific motifs or objects and find similar regions in an extensive dataset, helping art historians to analyze large digitized art collections. Computer vision has presented efficient methods for visual instance retrieval across photographs. However, applied to art collections, they reveal severe deficiencies because of diverse motifs and massive domain shifts induced by differences in techniques, materials, and styles. In this paper, we present a multi style feature fusion approach that successfully reduces the domain gap and improves retrieval results without labelled data or curated image collections. Our region based voting with GPU accelerated approximate nearest neighbour search allows us to find and localize even small motifs within an extensive dataset in a few seconds. We obtain state of the art results on the Brueghel dataset and demonstrate its generalization to inhomogeneous collections with a large number of distractors.


Talking After Lights Out An Ad Hoc Network for Electric Grid Recovery. When the electric grid in a region suffers a major outage, e.g., after a catastrophic cyber attack, a "black start" may be required, where the grid is slowly restarted, carefully and incrementally adding generating capacity and demand. To ensure safe and effective black start, the grid control center has to be able to communicate with field personnel and with supervisory control and data acquisition (SCADA) systems. Voice and text communication are particularly critical. As part of the Defense Advanced Research Projects Agency (DARPA) Rapid Attack Detection, Isolation, and Characterization Systems (RADICS) program, we designed, tested and evaluated a self configuring mesh network architecture and prototype called the Phoenix Secure Emergency Network (PhoenixSEN). PhoenixSEN is designed as a drop in replacement for primary communication networks, combines existing and new technologies, can work with a variety of link layer protocols, emphasizes manageability and auto configuration, and provides a core set of services and applications for coordination of people and devices including voice, text, and SCADA communication. The PhoenixSEN prototype was evaluated in the field through a series of DARPA led exercises. The same system is also likely to support coordination of recovery efforts after large scale natural disasters.


Enhancing ensemble learning and transfer learning in multimodal data analysis by adaptive dimensionality reduction. Modern data analytics take advantage of ensemble learning and transfer learning approaches to tackle some of the most relevant issues in data analysis, such as lack of labeled data to use to train the analysis models, sparsity of the information, and unbalanced distributions of the records. Nonetheless, when applied to multimodal datasets (i.e., datasets acquired by means of multiple sensing techniques or strategies), the state of theart methods for ensemble learning and transfer learning might show some limitations. In fact, in multimodal data analysis, not all observations would show the same level of reliability or information quality, nor an homogeneous distribution of errors and uncertainties. This condition might undermine the classic assumptions ensemble learning and transfer learning methods rely on. In this work, we propose an adaptive approach for dimensionality reduction to overcome this issue. By means of a graph theory based approach, the most relevant features across variable size subsets of the considered datasets are identified. This information is then used to set up ensemble learning and transfer learning architectures. We test our approach on multimodal datasets acquired in diverse research fields (remote sensing, brain computer interfaces, photovoltaic energy). Experimental results show the validity and the robustness of our approach, able to outperform state of the art techniques.


On Hosoya's dormants and sprouts. In a recent series of papers, Hosoya drew the attention to a particular aspect of constructing cospectral graphs by using coalescences that cospectral graphs can be constructed by attaching multiple copies of a rooted graph in different ways to subsets of vertices of an underlying graph. Our principal focus is to address the expectations and questions raised in Hosoya's papers with regards to this construction. We give an explicit formula for the characteristic polynomial of such multiple coalescences, from which we obtain a necessary and sufficient condition for their cospectrality. We enumerate such cospectral multiple coalescences for a few families of underlying graphs, and show the infinitude of cospectral multiple coalescences having paths as underlying graphs, which were deemed rare by Hosoya.


Compressive lensless endoscopy with partial speckle scanning. The lensless endoscope (LE) is a promising device to acquire in vivo images at a cellular scale. The tiny size of the probe enables a deep exploration of the tissues. Lensless endoscopy with a multicore fiber (MCF) commonly uses a spatial light modulator (SLM) to coherently combine, at the output of the MCF, few hundreds of beamlets into a focus spot. This spot is subsequently scanned across the sample to generate a fluorescent image. We propose here a novel scanning scheme, partial speckle scanning (PSS), inspired by compressive sensing theory, that avoids the use of an SLM to perform fluorescent imaging in LE with reduced acquisition time. Such a strategy avoids photo bleaching while keeping high reconstruction quality. We develop our approach on two key properties of the LE (i) the ability to easily generate speckles, and (ii) the memory effect in MCF that allows to use fast scan mirrors to shift light patterns. First, we show that speckles are sub exponential random fields. Despite their granular structure, an appropriate choice of the reconstruction parameters makes them good candidates to build efficient sensing matrices. Then, we numerically validate our approach and apply it on experimental data. The proposed sensing technique outperforms conventional raster scanning higher reconstruction quality is achieved with far fewer observations. For a fixed reconstruction quality, our speckle scanning approach is faster than compressive sensing schemes which require to change the speckle pattern for each observation.


Efficient Strong Scaling Through Burst Parallel Training. As emerging deep neural network (DNN) models continue to grow in size, using large GPU clusters to train DNNs is becoming an essential requirement to achieving acceptable training times. In this paper, we consider the case where future increases in cluster size will cause the global batch size that can be used to train models to reach a fundamental limit beyond a certain point, larger global batch sizes cause sample efficiency to degrade, increasing overall time to accuracy. As a result, to achieve further improvements in training performance, we must instead consider "strong scaling" strategies that hold the global batch size constant and allocate smaller batches to each GPU. Unfortunately, this makes it significantly more difficult to use cluster resources efficiently. We present DeepPool, a system that addresses this efficiency challenge through two key ideas. First, burst parallelism allocates large numbers of GPUs to foreground jobs in bursts to exploit the unevenness in parallelism across layers. Second, GPU multiplexing prioritizes throughput for foreground training jobs, while packing in background training jobs to reclaim underutilized GPU resources, thereby improving cluster wide utilization. Together, these two ideas enable DeepPool to deliver a 1.2 2.3x improvement in total cluster throughput over standard data parallelism with a single task when the cluster scale is large.


Know Your Customer Balancing Innovation and Regulation for Financial Inclusion. Financial inclusion depends on providing adjusted services for citizens with disclosed vulnerabilities. At the same time, the financial industry needs to adhere to a strict regulatory framework, which is often in conflict with the desire for inclusive, adaptive, privacy preserving services. In this paper we study how this tension impacts the deployment of privacy sensitive technologies aimed at financial inclusion. We conduct a qualitative study with banking experts to understand their perspective on service development for financial inclusion. We build and demonstrate a prototype solution based on open source decentralized identifiers and verifiable credentials software and report on feedback from the banking experts on this system. The technology is promising thanks to its selective disclosure of vulnerabilities to the full control of the individual. This support GDPR requirement, but at the same time, there is a clear tension between introducing these technologies and fulfilling other regulatory requirements, particularly with respect to Know Your Customer.' We consider the policy implications stemming from these tensions and provide guidelines for the further design of related technologies.


An extension of a depth inequality of Auslander. In this paper, we consider a depth inequality of Auslander which holds for finitely generated Tor rigid modules over commutative Noetherian local rings. We raise the question of whether such a depth inequality can be extended for n Tor rigid modules, and obtain an affirmative answer for 2 Tor rigid modules that are generically free. Furthermore, in the appendix, we use Dao's eta function and determine new classes of Tor rigid modules over hypersurfaces that are quotient of unramified regular local rings.


Asymptotic Fourier and Laplace transforms for vector valued hyperfunctions. We study Fourier and Laplace transforms for Fourier hyperfunctions with values in a complex locally convex Hausdorff space. Since any hyperfunction with values in a wide class of locally convex Hausdorff spaces can be extended to a Fourier hyperfunction, this gives simple notions of asymptotic Fourier and Laplace transforms for vector valued hyperfunctions, which improves the existing models of Komatsu, B "aumer, Lumer and Neubrander and Langenbruch.


Effective generation for foliated surfaces results and applications. We prove some results on the birational structure and invariants of a foliated surface (X, mathcal F) in terms of the adjoint divisor K mathcal F epsilon K X , 0 epsilon ll 1 . Several applications of these ideas are considered as well.


Usability Evaluation for Online Professional Search in the Dutch Archaeology Domain. This paper presents AGNES, the first information retrieval system for archaeological grey literature, allowing full text search of these long archaeological documents. This search system has a web interface that allows archaeology professionals and scholars to search through a collection of over 60,000 Dutch excavation reports, totalling 361 million words. We conducted a user study for the evaluation of AGNES's search interface, with a small but diverse user group. The evaluation was done by screen capturing and a think aloud protocol, combined with a user interface feedback questionnaire. The evaluation covered both controlled use (completion of a pre defined task) as well as free use (completion of a freely chosen task). The free use allows us to study the information needs of archaeologists, as well as their interactions with the search system. We conclude that (1) the information needs of archaeologists are typically recall oriented, often requiring a list of items as answer (2) the users prefer the use of free text queries over metadata filters, confirming the value of a free text search system (3) the compilation of a diverse user group contributed to the collection of diverse issues as feedback for improving the system. We are currently refining AGNES's user interface and improving its precision for archaeological entities, so that AGNES will help archaeologists to answer their research questions more effectively and efficiently, leading to a more coherent narrative of the past.


Generic Event Boundary Detection A Benchmark for Event Segmentation. This paper presents a novel task together with a new benchmark for detecting generic, taxonomy free event boundaries that segment a whole video into chunks. Conventional work in temporal video segmentation and action detection focuses on localizing pre defined action categories and thus does not scale to generic videos. Cognitive Science has known since last century that humans consistently segment videos into meaningful temporal chunks. This segmentation happens naturally, without pre defined event categories and without being explicitly asked to do so. Here, we repeat these cognitive experiments on mainstream CV datasets with our novel annotation guideline which addresses the complexities of taxonomy free event boundary annotation, we introduce the task of Generic Event Boundary Detection (GEBD) and the new benchmark Kinetics GEBD. Our Kinetics GEBD has the largest number of boundaries (e.g. 32 of ActivityNet, 8 of EPIC Kitchens 100) which are in the wild, taxonomy free, cover generic event change, and respect human perception diversity. We view GEBD as an important stepping stone towards understanding the video as a whole, and believe it has been previously neglected due to a lack of proper task definition and annotations. Through experiment and human study we demonstrate the value of the annotations. Further, we benchmark supervised and un supervised GEBD approaches on the TAPOS dataset and our Kinetics GEBD. We release our annotations and baseline codes at CVPR'21 LOVEU Challenge https sites.google.com view loveucvpr21.


Lifespan estimates for semilinear wave equations with space dependent damping and potential. In this work, we investigate the influence of general damping and potential terms on the blow up and lifespan estimates for energy solutions to power type semilinear wave equations. The space dependent damping and potential functions are assumed to be critical or short range, spherically symmetric perturbation. The blow up results and the upper bound of lifespan estimates are obtained by the so called test function method. The key ingredient is to construct special positive solutions to the linear dual problem with the desired asymptotic behavior, which is reduced, in turn, to constructing solutions to certain elliptic "eigenvalue" problems.


Strategizing University Rank Improvement using Interpretable Machine Learning and Data Visualization. Annual ranking of higher educational institutions (HEIs) is a global phenomenon and have significant impact on higher education landscape. Most of the HEIs pay close attention to ranking results and look forward to improving their ranks. However, maintaining a good rank and ascending in the rankings is a difficult task because it requires considerable resources, efforts and performance improvement plan. In this work, firstly, we show how exploratory data analysis (EDA) using correlation heatmaps and box plots can aid in understanding the broad trends in the ranking data. Subsequently, we present a novel idea of classifying the rankings data using Decision Tree (DT) based algorithms and retrieve decision paths for rank improvement using data visualization techniques. Using Laplace correction to the probability estimate, we quantify the amount of certainty attached with different decision paths obtained from interpretable DT models. The proposed methodology can aid Universities and HEIs to quantitatively assess the scope of improvement, adumbrate a fine grained long term action plan and prepare a suitable road map.


On the Expressivity of Markov Reward. Reward is the driving force for reinforcement learning agents. This paper is dedicated to understanding the expressivity of reward as a way to capture tasks that we would want an agent to perform. We frame this study around three new abstract notions of "task" that might be desirable (1) a set of acceptable behaviors, (2) a partial ordering over behaviors, or (3) a partial ordering over trajectories. Our main results prove that while reward can express many of these tasks, there exist instances of each task type that no Markov reward function can capture. We then provide a set of polynomial time algorithms that construct a Markov reward function that allows an agent to optimize tasks of each of these three types, and correctly determine when no such reward function exists. We conclude with an empirical study that corroborates and illustrates our theoretical findings.


Machine Learning for Naval Architecture, Ocean and Marine Engineering. Machine Learning (ML) based algorithms have found significant impact in many fields of engineering and sciences, where datasets are available from experiments and high fidelity numerical simulations. Those datasets are generally utilized in a machine learning model to extract information about the underlying physics and derive functional relationships mapping input variables to target quantities of interest. Commonplace machine learning algorithms utilized in Scientific Machine Learning (SciML) include neural networks, regression trees, random forests, support vector machines, etc. The focus of this article is to review the applications of ML in naval architecture, ocean, and marine engineering problems and identify priority directions of research. We discuss the applications of machine learning algorithms for different problems such as wave height prediction, calculation of wind loads on ships, damage detection of offshore platforms, calculation of ship added resistance, and various other applications in coastal and marine environments. The details of the data sets including the source of data sets utilized in the ML model development are included. The features used as the inputs to the ML models are presented in detail and finally, the methods employed in optimization of the ML models were also discussed. Based on this comprehensive analysis we point out future directions of research that may be fruitful for the application of ML to the ocean and marine engineering problems.


The Smoothed Likelihood of Doctrinal Paradox. When aggregating logically interconnected judgments from n agents, the result might be inconsistent with the logical connection. This inconsistency is known as the doctrinal paradox, which plays a central role in the field of judgment aggregation. Despite a large body of literature on the worst case analysis of the doctrinal paradox, little is known about its likelihood under natural statistical models, except for a few i.i.d. distributions List, 2005 . In this paper, we characterize the likelihood of the doctrinal paradox under a much more general and realistic model called the smoothed social choice framework Xia, 2020b , where agents' ground truth judgments are arbitrarily correlated while the noises are independent. Our main theorem states that under mild conditions, the smoothed likelihood of the doctrinal paradox is either 0 , exp( Theta(n)) , Theta(n 1 2 ) or Theta(1) . This not only answers open questions by List 2005 for i.i.d. distributions but also draws clear lines between situations with frequent and with vanishing paradoxes.


Primes in the Chebotarev density theorem for all number fields. We establish an explicit bound for the least prime occurring in the Chebotarev density theorem without any restriction. Let L K be any Galois extension of number fields such that L not mathbb Q , and let C be a conjugacy class in the Galois group of L K . We show that there exists an unramified prime mathfrak p of K such that sigma mathfrak p C and N mathfrak p le d L B with B 310 . This improves the value B 12 ,577 as proven by Ahn and Kwon. In comparison to previous works on the subject, we modify the weights to detect the least prime, and we use a new version of Tur 'an's power sum method which gives a stronger Deuring Heilbronn (zero repulsion) phenomenon. In addition, we refine the analysis of how the location of the potential exceptional zero for zeta L(s) affects the final result. We also use Fiori's numerical verification for L up to a certain discriminant height. Finally, we provide a lower bound for the number of unramified primes mathfrak p of K such that sigma mathfrak p C .


A stable 2 W continuous wave 261.5 nm laser for cooling and trapping aluminum monochloride. We present a high power tunable deep ultraviolet (DUV) laser that uses two consecutive cavity enhanced doubling stages with LBO and CLBO crystals to produce the fourth harmonic of an amplified homebuilt external cavity diode laser. The system generates up to 2.75 W of 261.5 nm laser light with a 2 W stable steady state output power and performs second harmonic generation in a largely unexplored high intensity regime in CLBO for continuous wave DUV light. We use this laser to perform fluorescence spectroscopy on the X 1 Sigma leftarrow A 1 Pi transition in a cold, slow beam of AlCl molecules and probe the A 1 Pi v' 0, J' 1 state hyperfine structure for future laser cooling and trapping experiments. This work demonstrates that the production of tunable, watt level DUV lasers is becoming routine for a variety of wavelength specific applications in atomic, molecular and optical physics.


Infinite time incompleteness of noncompact Yamabe flow. We show the noninheritance of the completeness of the noncompact Yamabe flow. Our main theorem states the existence of a long time solution which is complete for each time and converges to an incomplete Riemannian metric. This shows the occurrence of the infinite time incompleteness.


On Baselines for Local Feature Attributions. High performing predictive models, such as neural nets, usually operate as black boxes, which raises serious concerns about their interpretability. Local feature attribution methods help to explain black box models and are therefore a powerful tool for assessing the reliability and fairness of predictions. To this end, most attribution models compare the importance of input features with a reference value, often called baseline. Recent studies show that the baseline can heavily impact the quality of feature attributions. Yet, we frequently find simplistic baselines, such as the zero vector, in practice. In this paper, we show empirically that baselines can significantly alter the discriminative power of feature attributions. We conduct our analysis on tabular data sets, thus complementing recent works on image data. Besides, we propose a new taxonomy of baseline methods. Our experimental study illustrates the sensitivity of popular attribution models to the baseline, thus laying the foundation for a more in depth discussion on sensible baseline methods for tabular data.


Compact Packings are not always the Densest. We provide a counterexample to a conjecture by B. Connelly about density of circle packings


A remainder estimate for branched rough differential equations. We clarify the notion of branched rough paths. As an application, we provide a bound for the remainder of the truncated Taylor expansion for controlled differential equations driven by branched rough paths.


The African School of Fundamental Physics and Applications Activity Report 2019 2021. The sixth edition of the African School of Fundamental and Applied Physics (ASP) was planned for Morocco in July 2020 and was referred to as ASP2020. Preparations were at an advanced stage when ASP2020 was postponed because of the COVID 19 pandemic. The three week event was restructured into two activities in 2021 an online event on July 19 30, 2021 and a hybrid event on December 12 18, 2021 and was renamed ASP2021. At the beginning of the COVID 19 pandemic, an online lecture series was integrated into the ASP activities. The ASP mentorship program, which consists of online engagements between lecturers and assigned mentees, continued in this way. ASP alumni studied one year of COVID 19 data of ten African countries to offer insights into pandemic containment measures. In this note, we report on ASP activities since the last in person edition of ASP in 2018 in Namibia.


No Regrets for Learning the Prior in Bandits. We propose tt AdaTS , a Thompson sampling algorithm that adapts sequentially to bandit tasks that it interacts with. The key idea in tt AdaTS is to adapt to an unknown task prior distribution by maintaining a distribution over its parameters. When solving a bandit task, that uncertainty is marginalized out and properly accounted for. tt AdaTS is a fully Bayesian algorithm that can be implemented efficiently in several classes of bandit problems. We derive upper bounds on its Bayes regret that quantify the loss due to not knowing the task prior, and show that it is small. Our theory is supported by experiments, where tt AdaTS outperforms prior algorithms and works well even in challenging real world problems.


Enhance your smartphone with a Bluetooth Arduino nano board. Using smartphones in experimental physics teachings offers many advantages in term of engagement, pedagogy and flexibility. But it presents the drawbacks of possibly endangering the device and also facing the heterogeneity of available sensors on different smartphones. We present a low cost alternative that preserves the advantages of smartphones using a microcontroller equipped with a large variety of sensors that transmits data to a smartphone using Bluetooth Low Energy protocol. This device can be lent to students with little risks and used to perform a wide range of experiments. It opens the way to new types of physics teachings.


Enumeration of Hamiltonian Cycles on a Thick Grid Cylinder Part II Contractible Hamiltonian Cycles. In this series of papers, the primary goal is to enumerate Hamiltonian cycles (HC's) on the grid cylinder graphs P m 1 times C n , where n is allowed to grow whilst m is fixed. In Part I, we studied the so called non contractible HC's. Here, in Part II, we proceed further on to the contractible case. We propose two different novel characterizations of contractible HC's, from which we construct digraphs for enumerating the contractible HC's. Given the impression which the computational data for m leq 9 convey, we conjecture that the asymptotic domination of the contractible HC's versus the non contractible HC's, among the total number of HC's, depends on the parity of m .


Velocity Discretization for Lattice Boltzmann Method for Noncontinuum Bounded Gas Flows at the Micro and Nanoscale. The lattice Boltzmann (LB) method intrinsically links to the Boltzmann equation with the Bhatnagar Gross Krook collision operator however, it has been questioned to be able to simulate noncontinuum bounded gas flows at the micro and nanoscale, where gas moves at a low speed but has a large Knudsen number. In this article, this point has been verified by simulating Couette flows at moderate and large Knudsen numbers (e.g., Kn 10 and Kn 100) by the linearized LB models based on the popular half space Gaussian Hermite (HGH) quadrature. The underlying cause for poor accuracy of these conventional models is analyzed in light of numerical evaluation of the involved Abramowitz functions. A different thought on velocity discretization is then proposed using Gauss Legendre (LG) quadrature. Strikingly, the resulting GL based LB models have achieved high accuracy in simulating Couette flows in the strong transition and even free molecular flow regimes. The numerical study in this article reveals an essentially different while workable way in constructing LB models for simulating micro and nanoscale low speed gas flows with strong noncontinuum effects.


Enhanced Light Matter Interaction in B 10 Monoisotopic Boron Nitride Infrared Nanoresonators. Phonon polaritons, mixed excitations of light coupled to lattice vibrations (phonons), are emerging as a powerful platform for nanophotonic applications. This is because of their ability to concentrate light into extreme sub wavelength scales and because of their longer phonon lifetimes than their plasmonic counterparts. In this work, the infrared properties of phonon polaritonic nanoresonators made of monoisotopic B 10 hexagonal boron nitride (h BN) are explored, a material with increased phonon polariton lifetimes compared to naturally abundant h BN due to reduced photon scattering from randomly distributed isotopes. An average relative improvement of 50 in the nanoresonators Q factor is obtained with respect of nanoresonators made of naturally abundant h BN. Moreover, the monoisotopic h BN nano ribbon arrays are used to sense nanometric thick films of molecules, both through surface enhanced absorption spectroscopy and refractive index sensing. In addition, strong coupling is achieved between a molecular vibration and the phonon polariton resonance in monoisotopic h BN ribbons.


Examining convolutional feature extraction using Maximum Entropy (ME) and Signal to Noise Ratio (SNR) for image classification. Convolutional Neural Networks (CNNs) specialize in feature extraction rather than function mapping. In doing so they form complex internal hierarchical feature representations, the complexity of which gradually increases with a corresponding increment in neural network depth. In this paper, we examine the feature extraction capabilities of CNNs using Maximum Entropy (ME) and Signal to Noise Ratio (SNR) to validate the idea that, CNN models should be tailored for a given task and complexity of the input data. SNR and ME measures are used as they can accurately determine in the input dataset, the relative amount of signal information to the random noise and the maximum amount of information respectively. We use two well known benchmarking datasets, MNIST and CIFAR 10 to examine the information extraction and abstraction capabilities of CNNs. Through our experiments, we examine convolutional feature extraction and abstraction capabilities in CNNs and show that the classification accuracy or performance of CNNs is greatly dependent on the amount, complexity and quality of the signal information present in the input data. Furthermore, we show the effect of information overflow and underflow on CNN classification accuracies. Our hypothesis is that the feature extraction and abstraction capabilities of convolutional layers are limited and therefore, CNN models should be tailored to the input data by using appropriately sized CNNs based on the SNR and ME measures of the input dataset.


Successful New entry Prediction for Multi Party Online Conversations via Latent Topics and Discourse Modeling. With the increasing popularity of social media, online interpersonal communication now plays an essential role in people's everyday information exchange. Whether and how a newcomer can better engage in the community has attracted great interest due to its application in many scenarios. Although some prior works that explore early socialization have obtained salient achievements, they are focusing on sociological surveys based on the small group. To help individuals get through the early socialization period and engage well in online conversations, we study a novel task to foresee whether a newcomer's message will be responded to by other participants in a multi party conversation (henceforth Successful New entry Prediction). The task would be an important part of the research in online assistants and social media. To further investigate the key factors indicating such engagement success, we employ an unsupervised neural network, Variational Auto Encoder (VAE), to examine the topic content and discourse behavior from newcomer's chatting history and conversation's ongoing context. Furthermore, two large scale datasets, from Reddit and Twitter, are collected to support further research on new entries. Extensive experiments on both Twitter and Reddit datasets show that our model significantly outperforms all the baselines and popular neural models. Additional explainable and visual analyses on new entry behavior shed light on how to better join in others' discussions.


Periodic Reranking for Online Matching of Reusable Resources. We consider a generalization of the vertex weighted online bipartite matching problem where the offline vertices, called resources, are reusable. In particular, when a resource is matched it is unavailable for a deterministic time duration d after which it becomes available for a re match. Thus, a resource can be matched to many different online vertices over a period of time. While recent work on the problem has resolved the asymptotic case where we have large starting inventory (i.e., many copies) of every resource, we consider the (more general) case of unit inventory and give the first algorithm that is provably better than the na "ive greedy approach which has a competitive ratio of (exactly) 0.5. In particular, we achieve a competitive ratio of 0.589 against an LP relaxation of the offline problem.


Channel Modeling for Multi Receiver Molecular Communication Systems. Molecular Communication via Diffusion (MCvD) is a prominent small scale technology, which roots from the nature. Molecular single input single output (SISO) topology is one of the most studied molecular networks in the literature, with solid analytical foundations on channel behavior and advanced modulation techniques. Although molecular SISO topologies are well studied, the literature is yet to provide sufficient analytical modeling on multiple output systems with fully absorbing receivers. In this paper, a comprehensive recursive model for channel estimation and modeling of molecular single input multiple output (SIMO) systems is proposed as a sufficiently accurate channel approximation method. With its recursive nature, the model is used to estimate the channel behavior of molecular SIMO systems. A simplified approximation model is also presented with reduced computational requirements, resulting in slightly less accurate channel estimation. Analytical expressions for both models are derived. The performance of the proposed methods are evaluated via topological analysis and error metrics, and the methods show promising results on channel estimation compared to computer simulated data. Furthermore, the approximation matches quite well with the comprehensive model, which indicates significant success in terms of model performance.


L 2 critical nonuniqueness for the 2D Navier Stokes equations. In this paper, we consider the 2D incompressible Navier Stokes equations on the torus. It is well known that for any L 2 divergence free initial data, there exists a global smooth solution that is unique in the class of C t L 2 weak solutions. We show that such uniqueness would fail in the class C t L p if p 2 . The non unique solutions we constructed are almost L 2 critical in the sense that (i) they are uniformly continuous in L p for every p 2 (ii) the kinetic energy agrees with any given smooth positive profile except on a set of arbitrarily small measure in time.


BERT4GCN Using BERT Intermediate Layers to Augment GCN for Aspect based Sentiment Classification. Graph based Aspect based Sentiment Classification (ABSC) approaches have yielded state of the art results, expecially when equipped with contextual word embedding from pre training language models (PLMs). However, they ignore sequential features of the context and have not yet made the best of PLMs. In this paper, we propose a novel model, BERT4GCN, which integrates the grammatical sequential features from the PLM of BERT, and the syntactic knowledge from dependency graphs. BERT4GCN utilizes outputs from intermediate layers of BERT and positional information between words to augment GCN (Graph Convolutional Network) to better encode the dependency graphs for the downstream classification. Experimental results demonstrate that the proposed BERT4GCN outperforms all state of the art baselines, justifying that augmenting GCN with the grammatical features from intermediate layers of BERT can significantly empower ABSC models.


All Optical Experimental Control of High Harmonic Photon Energy. We generate high order harmonics in gaseous medium with tunable photon energy using time domain interferometry of double pulses in a non collinear generation geometry. The method is based on the fact that the generated harmonics inherit certain spectral properties of the driving laser. The two temporally delayed ultrashort laser pulses, identical in all parameters, are produced by a custom made split and delay unit utilizing wave front splitting without a significant energy loss. The arrangement is easy to implement in any attosecond pulse generation beamline, and is suitable for the production of an extreme ultraviolet source with simply and quickly variable central photon energy, useful for a broad range of applications.


An Estimation of Online Video User Engagement from Features of Continuous Emotions. Portraying emotion and trustworthiness is known to increase the appeal of video content. However, the causal relationship between these signals and online user engagement is not well understood. This limited understanding is partly due to a scarcity in emotionally annotated data and the varied modalities which express user engagement online. In this contribution, we utilise a large dataset of YouTube review videos which includes ca. 600 hours of dimensional arousal, valence and trustworthiness annotations. We investigate features extracted from these signals against various user engagement indicators including views, like dislike ratio, as well as the sentiment of comments. In doing so, we identify the positive and negative influences which single features have, as well as interpretable patterns in each dimension which relate to user engagement. Our results demonstrate that smaller boundary ranges and fluctuations for arousal lead to an increase in user engagement. Furthermore, the extracted time series features reveal significant (p 0.05) correlations for each dimension, such as, count below signal mean (arousal), number of peaks (valence), and absolute energy (trustworthiness). From this, an effective combination of features is outlined for approaches aiming to automatically predict several user engagement indicators. In a user engagement prediction paradigm we compare all features against semi automatic (cross task), and automatic (task specific) feature selection methods. These selected feature sets appear to outperform the usage of all features, e.g., using all features achieves 1.55 likes per day (Lp d) mean absolute error from valence this improves through semi automatic and automatic selection to 1.33 and 1.23 Lp d, respectively (data mean 9.72 Lp d with a std. 28.75 Lp d).


Unimodality and monotonic portions of certain domination polynomials. Given a simple graph G on n vertices, a subset of vertices U subseteq V(G) is dominating if every vertex of V(G) is either in U or adjacent to a vertex of U . The domination polynomial of G is the generating function whose coefficients are the number of dominating sets of a given size. We show that the domination polynomial is unimodal, i.e., the coefficients are non decreasing and then non increasing, for several well known families of graphs. In particular, we prove unimodality for spider graphs with at most 400 legs (of arbitrary length), lollipop graphs, arbitrary direct products of complete graphs, and Cartesian products of two complete graphs. We show that for every graph, a portion of the coefficients are non increasing, where the size of the portion depends on the upper domination number, and in certain cases this is sufficient to prove unimodality. Furthermore, we study graphs with m universal vertices, i.e., vertices adjacent to every other vertex, and show that the last ( frac 1 2 frac 1 2 m 1 ) n coefficients of their domination polynomial are non increasing.


DecGAN Decoupling Generative Adversarial Network detecting abnormal neural circuits for Alzheimer's disease. One of the main reasons for Alzheimer's disease (AD) is the disorder of some neural circuits. Existing methods for AD prediction have achieved great success, however, detecting abnormal neural circuits from the perspective of brain networks is still a big challenge. In this work, a novel decoupling generative adversarial network (DecGAN) is proposed to detect abnormal neural circuits for AD. Concretely, a decoupling module is designed to decompose a brain network into two parts one part is composed of a few sparse graphs which represent the neural circuits largely determining the development of AD the other part is a supplement graph, whose influence on AD can be ignored. Furthermore, the adversarial strategy is utilized to guide the decoupling module to extract the feature more related to AD. Meanwhile, by encoding the detected neural circuits to hypergraph data, an analytic module associated with the hyperedge neurons algorithm is designed to identify the neural circuits. More importantly, a novel sparse capacity loss based on the spatial spectral hypergraph similarity is developed to minimize the intrinsic topological distribution of neural circuits, which can significantly improve the accuracy and robustness of the proposed model. Experimental results demonstrate that the proposed model can effectively detect the abnormal neural circuits at different stages of AD, which is helpful for pathological study and early treatment.


Towards Photorealistic Colorization by Imagination. We present a novel approach to automatic image colorization by imitating the imagination process of human experts. Our imagination module is designed to generate color images that are context correlated with black and white photos. Given a black and white image, our imagination module firstly extracts the context information, which is then used to synthesize colorful and diverse images using a conditional image synthesis network (e.g., semantic image synthesis model). We then design a colorization module to colorize the black and white images with the guidance of imagination for photorealistic colorization. Experimental results show that our work produces more colorful and diverse results than state of the art image colorization methods. Our source codes will be publicly available.


Efficient Active Search for Combinatorial Optimization Problems. Recently numerous machine learning based methods for combinatorial optimization problems have been proposed that learn to construct solutions in a sequential decision process via reinforcement learning. While these methods can be easily combined with search strategies like sampling and beam search, it is not straightforward to integrate them into a high level search procedure offering strong search guidance. Bello et al. (2016) propose active search, which adjusts the weights of a (trained) model with respect to a single instance at test time using reinforcement learning. While active search is simple to implement, it is not competitive with state of the art methods because adjusting all model weights for each test instance is very time and memory intensive. Instead of updating all model weights, we propose and evaluate three efficient active search strategies that only update a subset of parameters during the search. The proposed methods offer a simple way to significantly improve the search performance of a given model and outperform state of the art machine learning based methods on combinatorial problems, even surpassing the well known heuristic solver LKH3 on the capacitated vehicle routing problem. Finally, we show that (efficient) active search enables learned models to effectively solve instances that are much larger than those seen during training.


Critical probabilistic characteristics of the Cram 'er model for primes and arithmetical properties. This work is a probabilistic study of the 'primes' of the Cram 'er model. We prove that there exists a set of integers mathcal S of density 1 such that begin equation liminf mathcal S ni n to infty ( log n) mathbb P S n hbox prime ge frac 1 sqrt 2 pi e , , end equation and that for b frac12 , the formula begin equation mathbb P S n text prime , , , frac (1 o( 1) ) sqrt 2 pi B n int m n sqrt 2bB n log n m n sqrt 2bB n log n , e frac (t m n) 2 2 B n , rm d pi(t), end equation in which m n mathbb E S n,B n rm Var ,S n , holds true for all n in mathcal S , n to infty . Further we prove that for any 0 eta 1 , and all n large enough and zeta 0 le zeta le exp big frac c log n log log n big , letting S' n sum j 8 n xi j , begin eqnarray mathbb P big S' n hbox zeta quasiprime big , ge , (1 eta) frac e gamma log zeta , end eqnarray according to Pintz's terminology, where c 0 and gamma is Euler's constant. We also test which infinite sequences of primes are ultimately avoided by the 'primes' of the Cram 'er model, with probability 1. Moreover we show that the Cram 'er model has incidences on the Prime Number Theorem, since it predicts that the error term is sensitive to subsequences. We obtain sharp results on the length and the number of occurrences of intervals I such as for some z 0 , begin equation sup n in I frac S n m n sqrt B n le z, end equation which are tied with the spectrum of the Sturm Liouville equation.


Change is Everywhere Single Temporal Supervised Object Change Detection in Remote Sensing Imagery. For high spatial resolution (HSR) remote sensing images, bitemporal supervised learning always dominates change detection using many pairwise labeled bitemporal images. However, it is very expensive and time consuming to pairwise label large scale bitemporal HSR remote sensing images. In this paper, we propose single temporal supervised learning (STAR) for change detection from a new perspective of exploiting object changes in unpaired images as supervisory signals. STAR enables us to train a high accuracy change detector only using textbf unpaired labeled images and generalize to real world bitemporal images. To evaluate the effectiveness of STAR, we design a simple yet effective change detector called ChangeStar, which can reuse any deep semantic segmentation architecture by the ChangeMixin module. The comprehensive experimental results show that ChangeStar outperforms the baseline with a large margin under single temporal supervision and achieves superior performance under bitemporal supervision. Code is available at https github.com Z Zheng ChangeStar


Trajectory Prediction for Autonomous Driving with Topometric Map. State of the art autonomous driving systems rely on high definition (HD) maps for localization and navigation. However, building and maintaining HD maps is time consuming and expensive. Furthermore, the HD maps assume structured environment such as the existence of major road and lanes, which are not present in rural areas. In this work, we propose an end to end transformer networks based approach for map less autonomous driving. The proposed model takes raw LiDAR data and noisy topometric map as input and produces precise local trajectory for navigation. We demonstrate the effectiveness of our method in real world driving data, including both urban and rural areas. The experimental results show that the proposed method outperforms state of the art multimodal methods and is robust to the perturbations of the topometric map. The code of the proposed method is publicly available at url https github.com Jiaolong trajectory prediction .


Yoneda's lemma for internal higher categories. We develop some basic concepts in the theory of higher categories internal to an arbitrary infty topos. We define internal left and right fibrations and prove a version of the Grothendieck construction and of Yoneda's lemma for internal categories.


Evaluation of Abstractive Summarisation Models with Machine Translation in Deliberative Processes. We present work on summarising deliberative processes for non English languages. Unlike commonly studied datasets, such as news articles, this deliberation dataset reflects difficulties of combining multiple narratives, mostly of poor grammatical quality, in a single text. We report an extensive evaluation of a wide range of abstractive summarisation models in combination with an off the shelf machine translation model. Texts are translated into English, summarised, and translated back to the original language. We obtain promising results regarding the fluency, consistency and relevance of the summaries produced. Our approach is easy to implement for many languages for production purposes by simply changing the translation model.


Predicting Airbnb Rental Prices Using Multiple Feature Modalities. Figuring out the price of a listed Airbnb rental is an important and difficult task for both the host and the customer. For the former, it can enable them to set a reasonable price without compromising on their profits. For the customer, it helps understand the key drivers for price and also provides them with similarly priced places. This price prediction regression task can also have multiple downstream uses, such as in recommendation of similar rentals based on price. We propose to use geolocation, temporal, visual and natural language features to create a reliable and accurate price prediction algorithm.


Server Side Local Gradient Averaging and Learning Rate Acceleration for Scalable Split Learning. In recent years, there have been great advances in the field of decentralized learning with private data. Federated learning (FL) and split learning (SL) are two spearheads possessing their pros and cons, and are suited for many user clients and large models, respectively. To enjoy both benefits, hybrid approaches such as SplitFed have emerged of late, yet their fundamentals have still been illusive. In this work, we first identify the fundamental bottlenecks of SL, and thereby propose a scalable SL framework, coined SGLR. The server under SGLR broadcasts a common gradient averaged at the split layer, emulating FL without any additional communication across clients as opposed to SplitFed. Meanwhile, SGLR splits the learning rate into its server side and client side rates, and separately adjusts them to support many clients in parallel. Simulation results corroborate that SGLR achieves higher accuracy than other baseline SL methods including SplitFed, which is even on par with FL consuming higher energy and communication costs. As a secondary result, we observe greater reduction in leakage of sensitive information via mutual information using SLGR over the baselines.


Theory Guided Machine Learning for Process Simulation of Advanced Composites. Science based simulation tools such as Finite Element (FE) models are routinely used in scientific and engineering applications. While their success is strongly dependent on our understanding of underlying governing physical laws, they suffer inherent limitations including trade off between fidelity accuracy and speed. The recent rise of Machine Learning (ML) proposes a theory agnostic paradigm. In complex multi physics problems, however, creating large enough datasets for successful training of ML models has proven to be challenging. One promising strategy to bridge the divide between these approaches and take advantage of their respective strengths is Theory Guided Machine Learning (TGML) which aims to integrate physical laws into ML algorithms. In this paper, three case studies on thermal management during processing of advanced composites are presented and studied using FE, ML and TGML. A structured approach to incrementally adding increasingly complex physics to training of TGML model is presented. The benefits of TGML over ML models are seen in more accurate predictions, particularly outside the training region, and ability to train with small datasets. One benefit of TGML over FE is significant speed improvement to potentially develop real time feedback systems. A recent successful implementation of a TGML model to assess producibility of aerospace composite parts is presented.


Submodular Concave. It has been well established that first order optimization methods can converge to the maximal objective value of concave functions and provide constant factor approximation guarantees for (non convex non concave) continuous submodular functions. In this work, we initiate the study of the maximization of functions of the form F(x) G(x) C(x) over a solvable convex body P , where G is a smooth DR submodular function and C is a smooth concave function. This class of functions is a strict extension of both concave and continuous DR submodular functions for which no theoretical guarantee is known. We provide a suite of Frank Wolfe style algorithms, which, depending on the nature of the objective function (i.e., if G and C are monotone or not, and non negative or not) and on the nature of the set P (i.e., whether it is downward closed or not), provide 1 1 e , 1 e , or 1 2 approximation guarantees. We then use our algorithms to get a framework to smoothly interpolate between choosing a diverse set of elements from a given ground set (corresponding to the mode of a determinantal point process) and choosing a clustered set of elements (corresponding to the maxima of a suitable concave function). Additionally, we apply our algorithms to various functions in the above class (DR submodular concave) in both constrained and unconstrained settings, and show that our algorithms consistently outperform natural baselines.


Counting essential minimal surfaces in closed negatively curved n manifolds. For closed odd dimensional manifolds with sectional curvature less or equal than 1, we define the minimal surface entropy that counts the number of surface subgroups. It attains the minimum if and only if the metric is hyperbolic. Moreover, we compute the entropy associated with other locally symmetric spaces and cusped hyperbolic 3 manifolds.


Offline Runtime Verification of Safety Requirements using CSP. Dynamic formal verification is a key tool for providing ongoing confidence that a system is meeting its requirements while in use, especially when paired with static formal verification before the system is in use. This paper presents a workflow and Runtime Verification (RV) toolchain, Varanus, and their application to an industrial case study. Using the workflow we manually derive a Communicating Sequential Processes (CSP) model from natural language safety requirements documents, which Varanus uses as the monitor oracle. This reuse of the model means that the monitor oracle does not have to be developed separately, risking inconsistencies between it and the model for static verification. The approach is demonstrated by the offline RV of a teleoperated manipulation system, called MASCOT, which enables remote operations inside the Joint European Torus (JET) fusion reactor. We describe our model of the MASCOT safety design documents (including how the modelling process revealed an underspecification in the design) and evaluate the Varanus toolchain's utility. The workflow and tool provide validation of the safety documents, traceability of the safety properties from the documentation to the system, and a verified oracle for RV.


Time Based Roofline for Deep Learning Performance Analysis. Deep learning applications are usually very compute intensive and require a long run time for training and inference. This has been tackled by researchers from both hardware and software sides, and in this paper, we propose a Roofline based approach to performance analysis to facilitate the optimization of these applications. This approach is an extension of the Roofline model widely used in traditional high performance computing applications, and it incorporates both compute bandwidth complexity and run time in its formulae to provide insights into deep learning specific characteristics. We take two sets of representative kernels, 2D convolution and long short term memory, to validate and demonstrate the use of this new approach, and investigate how arithmetic intensity, cache locality, auto tuning, kernel launch overhead, and Tensor Core usage can affect performance. Compared to the common ad hoc approach, this study helps form a more systematic way to analyze code performance and identify optimization opportunities for deep learning applications.


Subexponential parameterized algorithms and kernelization on almost chordal graphs. We study the algorithmic properties of the graph class Chordal ke, that is, graphs that can be turned into a chordal graph by adding at most k edges or, equivalently, the class of graphs of fill in at most k. We discover that a number of fundamental intractable optimization problems being parameterized by k admit subexponential algorithms on graphs from Chordal ke. We identify a large class of optimization problems on Chordal ke that admit algorithms with the typical running time 2 O( sqrt k log k) cdot n O(1) . Examples of the problems from this class are finding an independent set of maximum weight, finding a feedback vertex set or an odd cycle transversal of minimum weight, or the problem of finding a maximum induced planar subgraph. On the other hand, we show that for some fundamental optimization problems, like finding an optimal graph coloring or finding a maximum clique, are FPT on Chordal ke when parameterized by k but do not admit subexponential in k algorithms unless ETH fails. Besides subexponential time algorithms, the class of Chordal ke graphs appears to be appealing from the perspective of kernelization (with parameter k). While it is possible to show that most of the weighted variants of optimization problems do not admit polynomial in k kernels on Chordal ke graphs, this does not exclude the existence of Turing kernelization and kernelization for unweighted graphs. In particular, we construct a polynomial Turing kernel for Weighted Clique on Chordal ke graphs. For (unweighted) Independent Set we design polynomial kernels on two interesting subclasses of Chordal ke, namely, Interval ke and Split ke graphs.


An explicit expression for Euclidean self dual cyclic codes of length 2 k over Galois ring rm GR (4,m) . For any positive integers m and k , existing literature only determines the number of all Euclidean self dual cyclic codes of length 2 k over the Galois ring rm GR (4,m) , such as in Des. Codes Cryptogr. (2012) 63 105 112 . Using properties for Kronecker products of matrices of a specific type and column vectors of these matrices, we give a simple and efficient method to construct all these self dual cyclic codes precisely. On this basis, we provide an explicit expression to accurately represent all distinct Euclidean self dual cyclic codes of length 2 k over rm GR (4,m) , using combination numbers. As an application, we list all distinct Euclidean self dual cyclic codes over rm GR (4,m) of length 2 k explicitly, for k 4,5,6 .


Common Library 1.0 A Corpus of Victorian Novels Reflecting the Population in Terms of Publication Year and Author Gender. Research in 19th century book history, sociology of literature, and quantitative literary history is blocked by the absence of a collection of novels which captures the diversity of literary production. We introduce a corpus of 75 Victorian novels sampled from a 15,322 record bibliography of novels published between 1837 and 1901 in the British Isles. This corpus, the Common Library, is distinctive in the following way the shares of novels in the corpus associated with sociologically important subgroups match the shares in the broader population. For example, the proportion of novels written by women in 1880s in the corpus is approximately the same as in the population. Although we do not, in this particular paper, claim that the corpus is a representative sample in the familiar sense a sample is representative if "characteristics of interest in the population can be estimated from the sample with a known degree of accuracy" (Lohr 2010, p. 3) we are confident that the corpus will be useful to researchers. This is because existing corpora frequently convenience samples are conspicuously misaligned with the population of published novels. They tend to over represent novels published in specific periods and novels by men. The Common Library may be used alongside or in place of these non representative convenience corpora.


Teacher Student Competition for Unsupervised Domain Adaptation. With the supervision from source domain only in class level, existing unsupervised domain adaptation (UDA) methods mainly learn the domain invariant representations from a shared feature extractor, which causes the source bias problem. This paper proposes an unsupervised domain adaptation approach with Teacher Student Competition (TSC). In particular, a student network is introduced to learn the target specific feature space, and we design a novel competition mechanism to select more credible pseudo labels for the training of student network. We introduce a teacher network with the structure of existing conventional UDA method, and both teacher and student networks compete to provide target pseudo labels to constrain every target sample's training in student network. Extensive experiments demonstrate that our proposed TSC framework significantly outperforms the state of the art domain adaptation methods on Office 31 and ImageCLEF DA benchmarks.


High symmetric n polygons. The present article includes the enumeration of n polygons with a certain symmetry property For an even number n of vertices, we count the n polygons with frac n 2 symmetry axes. In addition, if n is a power of 2, we show the relation to the perfect numbers.


Aggregation Cross Entropy for Sequence Recognition. In this paper, we propose a novel method, aggregation cross entropy (ACE), for sequence recognition from a brand new perspective. The ACE loss function exhibits competitive performance to CTC and the attention mechanism, with much quicker implementation (as it involves only four fundamental formulas), faster inference back propagation (approximately O(1) in parallel), less storage requirement (no parameter and negligible runtime memory), and convenient employment (by replacing CTC with ACE). Furthermore, the proposed ACE loss function exhibits two noteworthy properties (1) it can be directly applied for 2D prediction by flattening the 2D prediction into 1D prediction as the input and (2) it requires only characters and their numbers in the sequence annotation for supervision, which allows it to advance beyond sequence recognition, e.g., counting problem. The code is publicly available at https github.com summerlvsong Aggregation Cross Entropy.


TBar Revisiting Template based Automated Program Repair. We revisit the performance of template based APR to build comprehensive knowledge about the effectiveness of fix patterns, and to highlight the importance of complementary steps such as fault localization or donor code retrieval. To that end, we first investigate the literature to collect, summarize and label recurrently used fix patterns. Based on the investigation, we build TBar, a straightforward APR tool that systematically attempts to apply these fix patterns to program bugs. We thoroughly evaluate TBar on the Defects4J benchmark. In particular, we assess the actual qualitative and quantitative diversity of fix patterns, as well as their effectiveness in yielding plausible or correct patches. Eventually, we find that, assuming a perfect fault localization, TBar correctly plausibly fixes 74 101 bugs. Replicating a standard and practical pipeline of APR assessment, we demonstrate that TBar correctly fixes 43 bugs from Defects4J, an unprecedented performance in the literature (including all approaches, i.e., template based, stochastic mutation based or synthesis based APR).


Genetic Random Weight Change Algorithm for the Learning of Multilayer Neural Networks. A new method to improve the performance of Random weight change (RWC) algorithm based on a simple genetic algorithm, namely, Genetic random weight change (GRWC) is proposed. It is to find the optimal values of global minima via learning. In contrast to Random Weight Change (RWC), GRWC contains an effective optimization procedure which are good at exploring a large and complex space in an intellectual strategies influenced by the GA RWC synergy. By implementing our simple GA in RWC we achieve an astounding accuracy of finding global minima.


Show or Tell? Demonstration is More Robust to Changes in Shared Perception than Explanation. Successful teaching entails a complex interaction between a teacher and a learner. The teacher must select and convey information based on what they think the learner perceives and believes. Teaching always involves misaligned beliefs, but studies of pedagogy often focus on situations where teachers and learners share perceptions. Nonetheless, a teacher and learner may not always experience or attend to the same aspects of the environment. Here, we study how misaligned perceptions influence communication. We hypothesize that the efficacy of different forms of communication depends on the shared perceptual state between teacher and learner. We develop a cooperative teaching game to test whether concrete mediums (demonstrations, or "showing") are more robust than abstract ones (language, or "telling") when the teacher and learner are not perceptually aligned. We find evidence that (1) language based teaching is more affected by perceptual misalignment, but (2) demonstration based teaching is less likely to convey nuanced information. We discuss implications for human pedagogy and machine learning.


Smart technology in the classroom a systematic review.Prospects for algorithmic accountability. Artificial intelligence (AI) algorithms have emerged in the educational domain as a tool to make learning more efficient. Different applications for mastering particular skills, learning new languages, and tracking their progress are used by children. What is the impact on children from using this smart technology? We conducted a systematic review to understand the state of the art. We explored the literature in several sub disciplines wearables, child psychology, AI and education, school surveillance, and accountability. Our review identified the need for more research for each established topic. We managed to find both positive and negative effects of using wearables, but cannot conclude if smart technology use leads to lowering the young children's performance. Based on our insights we propose a framework to effectively identify accountability for smart technology in education.


Flexible Functional Split and Power Control for Energy Harvesting Cloud Radio Access Networks. Functional split is a promising technique to flexibly balance the processing cost at remote ends and the fronthaul rate in cloud radio access networks (C RAN). By harvesting renewable energy, remote radio units (RRUs) can save grid power and be flexibly deployed. However, the randomness of energy arrival poses a major design challenge. To maximize the throughput under the average fronthaul rate constraint in C RAN with renewable powered RRUs, we first study the offline problem of selecting the optimal functional split modes and the corresponding durations, jointly with the transmission power. We find that between successive energy arrivals, at most two functional split modes should be selected. Then the optimal online problem is formulated as an Markov decision process (MDP). To deal with the curse of dimensionality of solving MDP, we further analyze the special case with one instance of energy arrival and two candidate functional split modes as inspired by the offline solution, and then a heuristic online policy is proposed. Numerical results show that with flexible functional split, the throughput can be significantly improved compared with fixed functional split. Also, the proposed heuristic online policy has similar performance with the optimal online one, as validated by simulations.


Which oxidation state of uranium and thorium as point defects in xenotime is favorable?. Relativistic study of xenotime, YPO 4 , containing atoms thorium and uranium as point defects is performed in the framework of cluster model with using the compound tunable embedding potential (CTEP) method proposed by us recently. The Y (PO 4 ) 6 Y' 22 O' 104 cluster for xenotime is considered, in which central part, Y (PO 4 ) 6 15 , is the main cluster, whereas outermost 22 atoms of yttrium and 104 atoms of oxygen are treated as its environment and compose electron free CTEP with the total charge of 15 . The P and O atoms of the orthophosphate groups nearest to the central Y atom are treated at all electron level. The central Y, its substitutes, Th and U, together with environmental Y atoms are described within different versions of the generalized relativistic pseudopotential method. Correctness of our cluster and CTEP models, constructed in the paper, is justified by comparing the Y O and P O bond lengths with corresponding periodic structure values of the ypo4 crystal, both experimental and theoretical. Using this cluster model, chemical properties of solitary point defects, X U, Th, in xenotime are analyzed. It has been shown that the oxidation state 3 is energetically more profitable than 4 not only for thorium but for uranium as well ( Delta E approx 5 eV) despite the notably higher ionic radius of U 3 compared to Y 3 , whereas ionic radii of U 4 and Y 3 are close. This leads to notable local deformation of crystal geometry around the U 3 impurity in xenotime and contradicts to widespread opinion about favorite oxidation state of uranium in such kind of minerals.


Context Aware Information Lapse for Timely Status Updates in Remote Control Systems. Emerging applications in Internet of Things (IoT), such as remote monitoring and control, extensively rely on timely status updates. Age of Information (AoI) has been proposed to characterize the freshness of information in status update systems. However, it only considers the time elapsed since the generation of the latest packet, and is incapable of capturing other critical information in remote control systems, such as the stochastic evolution and the importance of the source status. In order to evaluate the timeliness of status updates in remote control systems, we propose a context aware metric, namely the context aware information lapse. The context aware information lapse characterizes both the stochastic evolution of the source status and the context aware importance of the status. In this paper, the minimization of average context aware lapse in a multi user system is considered, and a corresponding user scheduling policy is proposed based on Lyapunov optimization. Numerical results show that compared to AoI based policy, the context aware lapse based policy can achieve a substantial improvement in terms of error threshold violation probability and control performance.


Restricted online Ramsey numbers of matchings and trees. Consider a two player game between players Builder and Painter. Painter begins the game by picking a coloring of the edges of K n , which is hidden from Builder. In each round, Builder points to an edge and Painter reveals its color. Builder's goal is to locate a particular monochromatic structure in Painter's coloring by revealing the color of as few edges as possible. The fewest number of turns required for Builder to win this game is known as the restricted online Ramsey number. In this paper, we consider the situation where this "particular monochromatic structure" is a large matching or a large tree. We show that in any t coloring of E(K n) , Builder can locate a monochromatic matching on at least n t 1 over t 1 edges by revealing at most O(n log t) edges. We show also that in any 3 coloring of E(K n) , Builder can locate a monochromatic tree on at least n 2 vertices by revealing at most 5n edges.


The universal six functor formalism. We prove that Morel Voevodsky's stable mathbb A 1 homotopy theory affords the universal six functor formalism.


Decomposing predictability Semantic feature overlap between words and the dynamics of reading for meaning. The present study uses a computational approach to examine the role of semantic constraints in normal reading. This methodology avoids confounds inherent in conventional measures of predictability, allowing for theoretically deeper accounts of semantic processing. We start from a definition of associations between words based on the significant log likelihood that two words co occur frequently together in the sentences of a large text corpus. Direct associations between stimulus words were controlled, and semantic feature overlap between prime and target words was manipulated by their common associates. The stimuli consisted of sentences of the form pronoun, verb, article, adjective and noun, followed by a series of closed class words, e. g. "She rides the grey elephant on one of her many exploratory voyages". The results showed that verb noun overlap reduces single and first fixation durations of the target noun and adjective noun overlap reduces go past durations. A dynamic spreading of activation account suggests that associates of the prime words take some time to become activated The verb can act on the target noun's early eye movement measures presented three words later, while the adjective is presented immediately prior to the target, which induces sentence re examination after a difficult adjective noun semantic integration.


Describing all multivariable functional equations of dilogarithms. We prove quite general statements about functional equations in any number of variables for the dilogarithms defined by Bloch Wigner, Rogers, and Coleman, showing that they follow from certain 5 term and 2 term relations in a precise way. Unlike many other references, we use arbitrary coefficients, do not ignore any torsion, and get sharp results. For the Bloch Wigner dilogarithm, we also consider complex conjugation, and for Coleman's p adic dilogarithm we show independence of the branch.


Variational Reward Estimator Bottleneck Learning Robust Reward Estimator for Multi Domain Task Oriented Dialog. Despite its notable success in adversarial learning approaches to multi domain task oriented dialog system, training the dialog policy via adversarial inverse reinforcement learning often fails to balance the performance of the policy generator and reward estimator. During optimization, the reward estimator often overwhelms the policy generator and produces excessively uninformative gradients. We proposes the Variational Reward estimator Bottleneck (VRB), which is an effective regularization method that aims to constrain unproductive information flows between inputs and the reward estimator. The VRB focuses on capturing discriminative features, by exploiting information bottleneck on mutual information. Empirical results on a multi domain task oriented dialog dataset demonstrate that the VRB significantly outperforms previous methods.


Deep Low Shot Learning for Biological Image Classification and Visualization from Limited Training Samples. Predictive modeling is useful but very challenging in biological image analysis due to the high cost of obtaining and labeling training data. For example, in the study of gene interaction and regulation in Drosophila embryogenesis, the analysis is most biologically meaningful when in situ hybridization (ISH) gene expression pattern images from the same developmental stage are compared. However, labeling training data with precise stages is very time consuming even for evelopmental biologists. Thus, a critical challenge is how to build accurate computational models for precise developmental stage classification from limited training samples. In addition, identification and visualization of developmental landmarks are required to enable biologists to interpret prediction results and calibrate models. To address these challenges, we propose a deep two step low shot learning framework to accurately classify ISH images using limited training images. Specifically, to enable accurate model training on limited training samples, we formulate the task as a deep low shot learning problem and develop a novel two step learning approach, including data level learning and feature level learning. We use a deep residual network as our base model and achieve improved performance in the precise stage prediction task of ISH images. Furthermore, the deep model can be interpreted by computing saliency maps, which consist of pixel wise contributions of an image to its prediction result. In our task, saliency maps are used to assist the identification and visualization of developmental landmarks. Our experimental results show that the proposed model can not only make accurate predictions, but also yield biologically meaningful interpretations. We anticipate our methods to be easily generalizable to other biological image classification tasks with small training datasets.


An intrinsic characterization of cofree representations of reductive groups. We formulate and partially verify a conjecture characterizing cofree representations of connected reductive groups. As we explain, this conjecture may be viewed as a natural generalization of the Chevalley Shepard Todd theorem from the case of finite groups to the case of connected reductive groups.


Novel Backoff Mechanism for Mitigation of Congestion in DSRC Broadcast. Due to the recent re allocation of the 5.9 GHz band by the US Federal Communications Commission (FCC), it will be inevitable that dedicated short range communications (DSRC) and cellular vehicle to everything (C V2X), two representative technologies for V2X, have to address coexistence. Especially, the distributed nature of DSRC makes it not trivial to control congestions due to an asynchronous structure, which makes it inefficient to disseminate a controlling signal. To this end, we propose a method to "lighten" a distributed V2X networking. Technically, it is to allocate the backoff counter according to the level of an accident risk to which a vehicle is temporarily exposed. We provide an analysis framework based on a spatiotemporal analysis. The numerical results show the improvement in the successful delivery of basic safety messages (BSMs).


Fictitious play in zero sum stochastic games. We present a novel variant of fictitious play dynamics combining classical fictitious play with Q learning for stochastic games and analyze its convergence properties in two player zero sum stochastic games. Our dynamics involves players forming beliefs on the opponent strategy and their own continuation payoff (Q function), and playing a greedy best response by using the estimated continuation payoffs. Players update their beliefs from observations of opponent actions. A key property of the learning dynamics is that update of the beliefs on Q functions occurs at a slower timescale than update of the beliefs on strategies. We show both in the model based and model free cases (without knowledge of player payoff functions and state transition probabilities), the beliefs on strategies converge to a stationary mixed Nash equilibrium of the zero sum stochastic game.


Economy Versus Disease Spread Reopening Mechanisms for COVID 19. We study mechanisms for reopening economic activities that explore the trade off between containing the spread of COVID 19 and maximizing economic impact. This is of current importance as many organizations, cities, and states are formulating reopening strategies. Our mechanisms, referred to as group scheduling, are based on partitioning the population into groups and scheduling each group on appropriate days with possible gaps (when all are quarantined). Each group interacts with no other group and, importantly, any person who is symptomatic in a group is quarantined. Specifically, our mechanisms are characterized by three parameters (g,d,t) , where g is the number of groups, d is the number of days a group is continuously scheduled, and t is the gap between cycles. We show that our mechanisms effectively trade off economic activity for more effective control of the COVID 19 virus. In particular, we show that the (2,5,0) mechanism, which partitions the population into two groups that alternatively work for five days each, flat lines the number of COVID 19 cases quite effectively, while still maintaining economic activity at 70 of pre COVID 19 level. We also study mechanisms such as (2,3,2) and (3,3,0) that achieve a somewhat lower economic output (about 50 ) at the cost of more aggressive control of the virus these could be applicable in situations when the disease spread is more rampant in the population. We demonstrate the efficacy of our mechanisms by theoretical analysis and extensive experimental simulations on various epidemiological models. Our mechanisms prove beneficial just by regulating human interactions. Moreover, our results show that if the disease transmission (reproductive) rate is made lower by following social distancing, mask wearing, and other public health guidelines, it can further increase the efficacy of our mechanisms.


A Probabilistic Generative Model of Linguistic Typology. In the principles and parameters framework, the structural features of languages depend on parameters that may be toggled on or off, with a single parameter often dictating the status of multiple features. The implied covariance between features inspires our probabilisation of this line of linguistic inquiry we develop a generative model of language based on exponential family matrix factorisation. By modelling all languages and features within the same architecture, we show how structural similarities between languages can be exploited to predict typological features with near perfect accuracy, outperforming several baselines on the task of predicting held out features. Furthermore, we show that language embeddings pre trained on monolingual text allow for generalisation to unobserved languages. This finding has clear practical and also theoretical implications the results confirm what linguists have hypothesised, i.e. that there are significant correlations between typological features and languages.


Span Selection Pre training for Question Answering. BERT (Bidirectional Encoder Representations from Transformers) and related pre trained Transformers have provided large gains across many language understanding tasks, achieving a new state of the art (SOTA). BERT is pre trained on two auxiliary tasks Masked Language Model and Next Sentence Prediction. In this paper we introduce a new pre training task inspired by reading comprehension to better align the pre training from memorization to understanding. Span Selection Pre Training (SSPT) poses cloze like training instances, but rather than draw the answer from the model's parameters, it is selected from a relevant passage. We find significant and consistent improvements over both BERT BASE and BERT LARGE on multiple reading comprehension (MRC) datasets. Specifically, our proposed model has strong empirical evidence as it obtains SOTA results on Natural Questions, a new benchmark MRC dataset, outperforming BERT LARGE by 3 F1 points on short answer prediction. We also show significant impact in HotpotQA, improving answer prediction F1 by 4 points and supporting fact prediction F1 by 1 point and outperforming the previous best system. Moreover, we show that our pre training approach is particularly effective when training data is limited, improving the learning curve by a large amount.


TuringAdvice A Generative and Dynamic Evaluation of Language Use. We propose TuringAdvice, a new challenge task and dataset for language understanding models. Given a written situation that a real person is currently facing, a model must generate helpful advice in natural language. Our evaluation framework tests a fundamental aspect of human language understanding our ability to use language to resolve open ended situations by communicating with each other. Empirical results show that today's models struggle at TuringAdvice, even multibillion parameter models finetuned on 600k in domain training examples. The best model, a finetuned T5, writes advice that is at least as helpful as human written advice in only 14 of cases a much larger non finetunable GPT3 model does even worse at 4 . This low performance reveals language understanding errors that are hard to spot outside of a generative setting, showing much room for progress.


physics.plasm-ph physics.class-ph physics.flu-dyn physics.pop-ph

Rotational properties of annulus dusty plasma in a strong magnetic field. The collective dynamics of annulus dusty plasma formed between a co centric conducting (non conducting) disk and ring configuration is studied in a strongly magnetized radio frequency (rf) discharge. A superconducting electromagnet is used to introduce a homogeneous magnetic field to the dusty plasma medium. In absence of the magnetic field, dust grains exhibit thermal motion around their equilibrium position. The dust grains start to rotate in anticlockwise direction with increasing magnetic field (B 0.02 T), and the constant value of the angular frequency at various strengths of magnetic field confirms the rigid body rotation. The angular frequency of dust grains linearly increases up to a threshold magnetic field (B 0.6 T) and after that its value remains nearly constant in a certain range of magnetic field. Further increase in magnetic field (B 1 T) lowers the angular frequency. Low value of angular frequency is expected by reducing the width of annulus dusty plasma or the input rf power. The azimuthal ion drag force due to the magnetic field is assumed to be the energy source which drives the rotational motion. The resultant radial electric field in the presence of magnetic field determines the direction of rotation. The variation of floating (plasma) potential across the annular region at given magnetic field explains the rotational properties of the annulus dusty plasma in the presence of magnetic field.


Sup norms of newforms on GL 2 with highly ramified central character. Recently, the problem of bounding the sup norms of L 2 normalized cuspidal automorphic newforms phi on text GL 2 in the level aspect has received much attention. However at the moment strong upper bounds are only available if the central character chi of phi is not too highly ramified. In this paper, we establish a uniform upper bound in the level aspect for general chi . If the level N is a square, our result reduces to phi infty ll N frac14 epsilon , at least under the Ramanujan Conjecture. In particular, when chi has conductor N , this improves upon the previous best known bound phi infty ll N frac12 epsilon in this setup (due to Saha 14 ) and matches a lower bound due to Templier 18 , thus our result is essentially optimal in this case.


The Unreasonable Effectiveness of Transformer Language Models in Grammatical Error Correction. Recent work on Grammatical Error Correction (GEC) has highlighted the importance of language modeling in that it is certainly possible to achieve good performance by comparing the probabilities of the proposed edits. At the same time, advancements in language modeling have managed to generate linguistic output, which is almost indistinguishable from that of human generated text. In this paper, we up the ante by exploring the potential of more sophisticated language models in GEC and offer some key insights on their strengths and weaknesses. We show that, in line with recent results in other NLP tasks, Transformer architectures achieve consistently high performance and provide a competitive baseline for future machine learning models.


Improving Augmentation and Evaluation Schemes for Semantic Image Synthesis. Despite data augmentation being a de facto technique for boosting the performance of deep neural networks, little attention has been paid to developing augmentation strategies for generative adversarial networks (GANs). To this end, we introduce a novel augmentation scheme designed specifically for GAN based semantic image synthesis models. We propose to randomly warp object shapes in the semantic label maps used as an input to the generator. The local shape discrepancies between the warped and non warped label maps and images enable the GAN to learn better the structural and geometric details of the scene and thus to improve the quality of generated images. While benchmarking the augmented GAN models against their vanilla counterparts, we discover that the quantification metrics reported in the previous semantic image synthesis studies are strongly biased towards specific semantic classes as they are derived via an external pre trained segmentation network. We therefore propose to improve the established semantic image synthesis evaluation scheme by analyzing separately the performance of generated images on the biased and unbiased classes for the given segmentation network. Finally, we show strong quantitative and qualitative improvements obtained with our augmentation scheme, on both class splits, using state of the art semantic image synthesis models across three different datasets. On average across COCO Stuff, ADE20K and Cityscapes datasets, the augmented models outperform their vanilla counterparts by 3 mIoU and 10 FID points.


A "Final" Security Bug. This article discusses a fixed critical security bug in Google Tink's Ed25519 Java implementation. The bug allows remote attackers to extract the private key with only two Ed25519 signatures. The vulnerability comes from the misunderstanding of what "final" in Java programming language means. The bug was discovered during security review before Google Tink was officially released. It reinforces the challenge in writing safe cryptographic code and the importance of the security review process even for the code written by professional cryptographers.


Random cones in high dimensions I Donoho Tanner and Cover Efron cones. Two models of random cones in high dimensions are considered, together with their duals. The Donoho Tanner random cone D n,d can be defined as the positive hull of n independent d dimensional Gaussian random vectors. The Cover Efron random cone C n,d is essentially defined as the same positive hull, conditioned on the event that it is not the whole space. We consider expectations of various combinatorial and geometric functionals of these random cones and prove that they satisfy limit theorems, as d and n tend to infinity in a suitably coordinated way. This includes, for example, large deviation principles and central as well as non central limit theorems for the expected number of k faces and the k th conic intrinsic volumes, as n , d and possibly also k tend to infinity simultaneously. Furthermore, we determine the precise high dimensional asymptotic behaviour of the expected statistical dimension for both models of random cones, uncovering thereby another high dimensional phase transition. As an application, limit theorems for the number of k faces of high dimensional polytopes generated by random Gale diagrams are discussed as well.


Conjugacy classes of p elements and normal p complements. In this paper, we study the structure of finite groups with a large number of conjugacy classes of p elements for some prime p . As consequences, we obtain some new criteria for the existence of normal p complements in finite groups.


Does a central limit theorem hold for the k skeleton of Poisson hyperplanes in hyperbolic space?. Poisson processes in the space of (d 1) dimensional totally geodesic subspaces (hyperplanes) in a d dimensional hyperbolic space of constant curvature 1 are studied. The k dimensional Hausdorff measure of their k skeleton is considered. Explicit formulas for first and second order quantities restricted to bounded observation windows are obtained. The central limit problem for the k dimensional Hausdorff measure of the k skeleton is approached in two different set ups (i) for a fixed window and growing intensities, and (ii) for fixed intensity and growing spherical windows. While in case (i) the central limit theorem is valid for all d geq 2 , it is shown that in case (ii) the central limit theorem holds for d in 2,3 and fails if d geq 4 and k d 1 or if d geq 7 and for general k . Also rates of convergence are studied and multivariate central limit theorems are obtained. Moreover, the situation in which the intensity and the spherical window are growing simultaneously is discussed. In the background are the Malliavin Stein method for normal approximation and the combinatorial moment structure of Poisson U statistics as well as tools from hyperbolic integral geometry.


A BERT based Distractor Generation Scheme with Multi tasking and Negative Answer Training Strategies. In this paper, we investigate the following two limitations for the existing distractor generation (DG) methods. First, the quality of the existing DG methods are still far from practical use. There is still room for DG quality improvement. Second, the existing DG designs are mainly for single distractor generation. However, for practical MCQ preparation, multiple distractors are desired. Aiming at these goals, in this paper, we present a new distractor generation scheme with multi tasking and negative answer training strategies for effectively generating textit multiple distractors. The experimental results show that (1) our model advances the state of the art result from 28.65 to 39.81 (BLEU 1 score) and (2) the generated multiple distractors are diverse and show strong distracting power for multiple choice question.


How to Support Users in Understanding Intelligent Systems? Structuring the Discussion. The opaque nature of many intelligent systems violates established usability principles and thus presents a challenge for human computer interaction. Research in the field therefore highlights the need for transparency, scrutability, intelligibility, interpretability and explainability, among others. While all of these terms carry a vision of supporting users in understanding intelligent systems, the underlying notions and assumptions about users and their interaction with the system often remain unclear. We review the literature in HCI through the lens of implied user questions to synthesise a conceptual framework integrating user mindsets, user involvement, and knowledge outcomes to reveal, differentiate and classify current notions in prior work. This framework aims to resolve conceptual ambiguity in the field and enables researchers to clarify their assumptions and become aware of those made in prior work. We thus hope to advance and structure the dialogue in the HCI research community on supporting users in understanding intelligent systems.